Jul 09 16:13:29.441745 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 16:13:29.441756 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 16:13:29.441770 ip-10-0-139-93 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 16:13:29.442012 ip-10-0-139-93 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 16:13:39.647264 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 16:13:39.647282 ip-10-0-139-93 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2ac605b099d44c8aa60ba1fa75d65d83 -- Jul 09 16:15:44.006538 ip-10-0-139-93 systemd[1]: Starting Kubernetes Kubelet... Jul 09 16:15:44.377789 ip-10-0-139-93 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:15:44.377789 ip-10-0-139-93 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 16:15:44.377789 ip-10-0-139-93 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:15:44.377789 ip-10-0-139-93 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 16:15:44.377789 ip-10-0-139-93 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:15:44.378444 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.377777 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 16:15:44.384107 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384090 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.384107 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384106 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384110 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384113 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384116 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384119 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384121 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384124 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384129 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384131 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384134 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384137 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384140 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384143 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384145 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384148 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384150 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384158 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384161 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384164 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384167 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.384169 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384169 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384172 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384175 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384178 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384181 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384184 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384187 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384189 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384192 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384195 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384197 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384200 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384202 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384204 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384207 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384209 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384211 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384215 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384217 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384220 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.384688 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384223 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384226 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384228 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384231 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384233 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384236 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384238 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384241 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384243 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384245 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384260 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384262 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384265 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384268 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384270 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384273 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384275 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384278 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384280 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384283 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.385279 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384285 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384288 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384290 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384293 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384295 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384298 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384301 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384303 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384307 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384311 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384315 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384318 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384320 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384324 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384328 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384331 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384334 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384336 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384339 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.385768 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384342 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384345 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384349 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384352 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384356 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384358 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384361 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384364 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384366 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384369 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384371 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384374 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384377 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384379 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384381 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384384 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384386 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384389 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.384391 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.386222 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385129 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385137 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385140 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385144 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385146 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385149 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385151 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385154 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385157 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385160 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385162 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385165 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385169 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385171 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385174 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385177 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385179 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385182 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385184 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385188 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.386682 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385190 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385193 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385196 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385198 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385201 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385203 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385205 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385217 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385221 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385224 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385226 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385229 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385232 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385235 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385238 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385240 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385243 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385245 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385262 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385265 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.387205 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385267 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385271 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385274 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385277 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385279 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385282 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385284 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385287 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385290 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385293 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385297 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385301 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385304 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385307 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385310 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385313 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385315 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385317 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385320 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385323 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.387710 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385325 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385328 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385330 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385333 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385335 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385338 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385341 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385343 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385347 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385351 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385353 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385356 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385358 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385361 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385364 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385366 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385369 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385372 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385374 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.388199 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385377 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385379 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385382 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385385 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385387 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385390 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385392 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385395 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385399 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385403 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385406 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385409 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385412 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385415 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385417 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385420 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385423 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385425 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385428 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385431 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.388677 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385802 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385808 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385811 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385814 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385817 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385820 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385822 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385826 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385831 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385834 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385837 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385840 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385842 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385845 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385847 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385850 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385852 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385855 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385859 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385862 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.389149 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385865 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385868 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385871 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385874 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385877 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385879 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385882 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385884 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385887 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385889 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385892 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385894 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385896 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385899 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385901 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385904 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385907 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385910 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385912 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385915 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.389654 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385918 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385921 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385923 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385925 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385928 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385930 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385932 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385935 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385937 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385940 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385942 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385945 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385947 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385949 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385952 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385954 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385957 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385959 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385962 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385965 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.390131 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385967 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385970 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385972 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385974 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385977 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385979 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385982 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385984 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385987 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385989 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385991 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385994 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385996 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.385999 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386002 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386004 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386007 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386009 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.390633 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386012 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386017 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386020 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386023 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386026 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386029 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386031 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386034 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386036 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386039 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386041 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386044 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386046 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386048 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386051 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386053 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386055 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386058 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386060 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.391075 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386063 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386065 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386148 2571 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386159 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386166 2571 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386170 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386174 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386177 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386181 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386185 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386189 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386192 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386196 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386199 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386202 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386205 2571 flags.go:64] FLAG: --cgroup-root="" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386207 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386210 2571 flags.go:64] FLAG: --client-ca-file="" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386213 2571 flags.go:64] FLAG: --cloud-provider="external" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386216 2571 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386220 2571 flags.go:64] FLAG: --cluster-domain="" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386223 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386226 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386229 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 16:15:44.391540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386232 2571 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386236 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386238 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386241 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386245 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386262 2571 flags.go:64] FLAG: --contention-profiling="false" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386265 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386268 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386271 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386274 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386280 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386283 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386286 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386289 2571 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386291 2571 flags.go:64] FLAG: --enable-server="true" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386294 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386299 2571 flags.go:64] FLAG: --event-burst="100" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386302 2571 flags.go:64] FLAG: --event-qps="50" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386304 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386308 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386311 2571 flags.go:64] FLAG: --eviction-hard="" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386314 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386317 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386320 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386322 2571 flags.go:64] FLAG: --eviction-soft="" Jul 09 16:15:44.392108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386325 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386328 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386331 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386334 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386336 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386339 2571 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386342 2571 flags.go:64] FLAG: --feature-gates="" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386345 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386348 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386351 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386354 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386357 2571 flags.go:64] FLAG: --healthz-port="10248" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386362 2571 flags.go:64] FLAG: --help="false" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386365 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386368 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386371 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386373 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386378 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386382 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386384 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386387 2571 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386390 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386393 2571 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 16:15:44.392749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386395 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386398 2571 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386401 2571 flags.go:64] FLAG: --kube-reserved="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386404 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386407 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386410 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386413 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386416 2571 flags.go:64] FLAG: --lock-file="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386418 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386421 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386424 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386429 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386432 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386434 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386437 2571 flags.go:64] FLAG: --logging-format="text" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386440 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386443 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386446 2571 flags.go:64] FLAG: --manifest-url="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386449 2571 flags.go:64] FLAG: --manifest-url-header="" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386453 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386456 2571 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386462 2571 flags.go:64] FLAG: --max-pods="110" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386464 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386467 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386470 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 16:15:44.393341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386473 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386478 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386481 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386484 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386491 2571 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386493 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386496 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386499 2571 flags.go:64] FLAG: --pod-cidr="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386502 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386507 2571 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386510 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386513 2571 flags.go:64] FLAG: --pods-per-core="0" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386516 2571 flags.go:64] FLAG: --port="10250" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386519 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386522 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041f5c1a655aeec6c" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386525 2571 flags.go:64] FLAG: --qos-reserved="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386528 2571 flags.go:64] FLAG: --read-only-port="10255" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386530 2571 flags.go:64] FLAG: --register-node="true" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386533 2571 flags.go:64] FLAG: --register-with-taints="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386536 2571 flags.go:64] FLAG: --registry-burst="10" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386539 2571 flags.go:64] FLAG: --registry-qps="5" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386542 2571 flags.go:64] FLAG: --reserved-cpus="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386544 2571 flags.go:64] FLAG: --reserved-memory="" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386548 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386551 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 16:15:44.393941 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386554 2571 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386557 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386559 2571 flags.go:64] FLAG: --runonce="false" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386563 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386566 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386569 2571 flags.go:64] FLAG: --seccomp-default="false" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386571 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386574 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386577 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386581 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386584 2571 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386587 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386590 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386593 2571 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386595 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386598 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386601 2571 flags.go:64] FLAG: --system-cgroups="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386603 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386609 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386612 2571 flags.go:64] FLAG: --tls-cert-file="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386616 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386620 2571 flags.go:64] FLAG: --tls-min-version="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386623 2571 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386625 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386628 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 16:15:44.394585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386631 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386633 2571 flags.go:64] FLAG: --v="2" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386637 2571 flags.go:64] FLAG: --version="false" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386641 2571 flags.go:64] FLAG: --vmodule="" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386644 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.386647 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386789 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386793 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386796 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386799 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386803 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386805 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386808 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386810 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386813 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386815 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386818 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386821 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386824 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386826 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386829 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.395167 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386831 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386834 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386836 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386839 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386841 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386843 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386846 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386849 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386851 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386854 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386856 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386859 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386861 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386863 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386866 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386868 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386870 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386873 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386875 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386878 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.395801 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386880 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386884 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386886 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386889 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386891 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386893 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386896 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386901 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386903 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386907 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386911 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386914 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386916 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386919 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386922 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386924 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386927 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386929 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386932 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.396332 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386935 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386938 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386940 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386943 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386945 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386948 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386952 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386955 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386958 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386961 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386963 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386966 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386969 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386971 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386976 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386978 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386981 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386983 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386985 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.396795 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386988 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386991 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386994 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386996 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.386999 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387001 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387004 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387006 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387009 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387011 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387013 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387016 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387018 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387021 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387023 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387026 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387028 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387031 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387033 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387036 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.397275 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387039 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387041 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387043 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387046 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387048 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.387052 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.388085 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397043 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397065 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397084 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397089 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397148 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397153 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397156 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.397750 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397159 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397162 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397166 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397168 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397171 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397174 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397177 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397179 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397182 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397184 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397187 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397189 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397192 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397195 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397197 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397200 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397202 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397204 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397207 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397218 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.398101 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397221 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397223 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397226 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397228 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397231 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397234 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397239 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397242 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397244 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397264 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397269 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397273 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397276 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397279 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397282 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397285 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397288 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397291 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397294 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397297 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.398593 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397300 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397303 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397306 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397309 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397312 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397314 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397317 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397319 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397322 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397324 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397327 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397329 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397332 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397335 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397337 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397340 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397342 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397345 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397348 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397352 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.399071 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397354 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397357 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397359 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397362 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397364 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397367 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397369 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397371 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397374 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397376 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397379 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397381 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397385 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397389 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397393 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397396 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397398 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397401 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397403 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.399629 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397406 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397408 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397411 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397413 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397415 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397418 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397420 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397423 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397426 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397428 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397431 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397434 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397436 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397439 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397442 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397444 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.400074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397447 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397452 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397586 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397592 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397595 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397598 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397601 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397603 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397606 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397608 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397611 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397613 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397615 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397618 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397620 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:15:44.400470 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397623 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397626 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397631 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397634 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397636 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397639 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397642 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397644 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397647 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397649 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397651 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397654 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397657 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397660 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397662 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397665 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397668 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397670 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397673 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397675 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:15:44.400831 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397678 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397680 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397683 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397685 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397688 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397690 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397692 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397694 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397697 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397699 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397701 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397704 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397706 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397708 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397711 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397713 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397716 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397718 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397720 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397723 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:15:44.401331 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397725 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397727 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397730 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397733 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397735 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397738 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397740 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397743 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397747 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397750 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397753 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397756 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397759 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397761 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397764 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397766 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397769 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397772 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397775 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:15:44.401881 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397778 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397780 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397783 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397785 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397788 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397790 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397793 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397795 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397798 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397800 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397802 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397805 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397807 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397810 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397812 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397815 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397818 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397821 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397824 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:15:44.402353 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397826 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397828 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397831 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397834 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397837 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397839 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397841 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:44.397844 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397848 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.397984 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.399983 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.401425 2571 server.go:1019] "Starting client certificate rotation" Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.401528 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:15:44.402829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.401573 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:15:44.404257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.404229 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:15:44.407884 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.407842 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:15:44.417169 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.417142 2571 log.go:25] "Validated CRI v1 runtime API" Jul 09 16:15:44.419376 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.419359 2571 log.go:25] "Validated CRI v1 image API" Jul 09 16:15:44.420909 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.420877 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 16:15:44.423671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.423646 2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 815a5977-43c1-4667-8048-3f7e521d6eec:/dev/nvme0n1p3 b961bf27-ec4a-433c-9fcd-8a15d8d7f694:/dev/nvme0n1p4] Jul 09 16:15:44.423744 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.423670 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 16:15:44.429667 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.429496 2571 manager.go:216] Machine: {Timestamp:2026-07-09 16:15:44.428276711 +0000 UTC m=+0.309278849 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102961 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d43979a2a4bd48ea5db4ff34a14fb SystemUUID:ec2d4397-9a2a-4bd4-8ea5-db4ff34a14fb BootID:2ac605b0-99d4-4c8a-a60b-a1fa75d65d83 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:95:b5:fe:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:95:b5:fe:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:b9:ef:f8:63:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 16:15:44.429667 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.429661 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 16:15:44.429794 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.429765 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 16:15:44.430841 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.430812 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 16:15:44.430997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.430844 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 16:15:44.431544 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.431529 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:15:44.431642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.431628 2571 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 16:15:44.431676 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.431651 2571 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 16:15:44.431707 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.431672 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:15:44.433327 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.433313 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:15:44.434534 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.434523 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 16:15:44.437451 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437438 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:15:44.437582 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437572 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 16:15:44.437621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437604 2571 kubelet.go:486] "Attempting to sync node with API server" Jul 09 16:15:44.437621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437613 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 16:15:44.437700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437628 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 16:15:44.437700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437638 2571 kubelet.go:398] "Adding apiserver pod source" Jul 09 16:15:44.437700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437647 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 16:15:44.438007 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.437992 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:15:44.438044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.438020 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:15:44.441647 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.441629 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 16:15:44.444042 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444026 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 16:15:44.444117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444058 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 16:15:44.444263 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444236 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 16:15:44.444330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444275 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 16:15:44.444330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444288 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 16:15:44.444330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444294 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 16:15:44.444330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444303 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 16:15:44.444330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444308 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 16:15:44.444692 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444682 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 16:15:44.444692 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444692 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 16:15:44.444792 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444712 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 16:15:44.444792 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444718 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 16:15:44.444792 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444733 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 16:15:44.444792 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.444742 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 16:15:44.445282 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.445261 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 16:15:44.445282 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.445273 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 16:15:44.447519 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.447497 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 16:15:44.447630 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.447589 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 16:15:44.447736 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.447720 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 16:15:44.448681 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.448651 2571 server.go:1268] "Started kubelet" Jul 09 16:15:44.448834 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.448766 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 16:15:44.448938 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.448894 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 16:15:44.452616 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.448808 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 16:15:44.453678 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.453658 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 16:15:44.453764 ip-10-0-139-93 systemd[1]: Started Kubernetes Kubelet. Jul 09 16:15:44.457171 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.457151 2571 server.go:310] "Adding debug handlers to kubelet server" Jul 09 16:15:44.457797 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.457769 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkgs5" Jul 09 16:15:44.459767 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.459749 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 16:15:44.461178 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.460042 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-93.ec2.internal.18c0ab40265d3f17 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-93.ec2.internal,UID:ip-10-0-139-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-93.ec2.internal,},FirstTimestamp:2026-07-09 16:15:44.448618263 +0000 UTC m=+0.329620399,LastTimestamp:2026-07-09 16:15:44.448618263 +0000 UTC m=+0.329620399,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-93.ec2.internal,}" Jul 09 16:15:44.461338 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.461268 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 16:15:44.461338 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.461278 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 16:15:44.461449 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.461435 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:44.462074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.461979 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 16:15:44.462074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462024 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 16:15:44.462074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462043 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 16:15:44.462238 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462124 2571 reconstruct.go:97] "Volume reconstruction finished" Jul 09 16:15:44.462238 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462131 2571 reconciler.go:29] "Reconciler: start to sync state" Jul 09 16:15:44.462482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462463 2571 factory.go:55] Registering systemd factory Jul 09 16:15:44.462482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462484 2571 factory.go:223] Registration of the systemd container factory successfully Jul 09 16:15:44.462712 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462699 2571 factory.go:153] Registering CRI-O factory Jul 09 16:15:44.462754 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462715 2571 factory.go:223] Registration of the crio container factory successfully Jul 09 16:15:44.462783 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462757 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 16:15:44.462783 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462776 2571 factory.go:103] Registering Raw factory Jul 09 16:15:44.462843 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462786 2571 manager.go:1196] Started watching for new ooms in manager Jul 09 16:15:44.462905 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.462891 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkgs5" Jul 09 16:15:44.463365 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.463351 2571 manager.go:349] Starting recovery of all containers Jul 09 16:15:44.468970 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.468940 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:44.471840 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.471820 2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-93.ec2.internal\" not found" node="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.475428 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.475265 2571 manager.go:354] Recovery completed Jul 09 16:15:44.480029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.480015 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.482034 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482014 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.482113 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482056 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.482113 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482069 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.482679 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482666 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 16:15:44.482743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482679 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 16:15:44.482743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482684 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.482743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.482695 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:15:44.483968 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.483946 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.484055 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.483987 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.484055 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.484004 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.485294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.485276 2571 policy_none.go:49] "None policy: Start" Jul 09 16:15:44.485382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.485309 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 16:15:44.485382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.485325 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 16:15:44.486619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.486608 2571 policy_none.go:47] "Start" Jul 09 16:15:44.525825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.525806 2571 manager.go:337] "Starting Device Plugin manager" Jul 09 16:15:44.525924 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.525839 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 16:15:44.525924 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.525850 2571 server.go:87] "Starting device plugin registration server" Jul 09 16:15:44.526139 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.526128 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 16:15:44.526221 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.526142 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 16:15:44.526320 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.526304 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 16:15:44.526403 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.526387 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 16:15:44.526403 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.526400 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 16:15:44.526988 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.526968 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 16:15:44.527078 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.527023 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:44.626789 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.626731 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.628117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.627821 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.628117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.627850 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.628117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.627862 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.628117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.627896 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.634745 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.634712 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 16:15:44.635880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.635859 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.636022 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.635884 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-93.ec2.internal\": node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:44.636315 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.636299 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 16:15:44.636374 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.636355 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 16:15:44.636411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.636387 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 16:15:44.636456 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.636428 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 16:15:44.639075 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.639054 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:44.713792 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.713762 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:44.736892 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.736858 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal"] Jul 09 16:15:44.736970 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.736945 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.739189 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.739171 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.739298 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.739203 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.739298 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.739212 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.740404 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.740392 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.740521 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.740506 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.740558 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.740537 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.741420 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741399 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.741517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741436 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.741517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741448 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.741517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741405 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.741517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741509 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.741636 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.741521 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.742798 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.742781 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.742873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.742808 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:15:44.744904 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.744887 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:15:44.744988 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.744920 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:15:44.744988 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.744934 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:15:44.763311 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.763278 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.763436 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.763315 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.763436 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.763336 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e421a41c11e9140343823d9a1fa9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"a5e421a41c11e9140343823d9a1fa9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.768121 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.768103 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-93.ec2.internal\" not found" node="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.772493 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.772475 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-93.ec2.internal\" not found" node="ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.814528 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.814490 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:44.864062 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864028 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.864062 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864061 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.864310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864079 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e421a41c11e9140343823d9a1fa9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"a5e421a41c11e9140343823d9a1fa9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.864310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864121 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a5e421a41c11e9140343823d9a1fa9d3-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"a5e421a41c11e9140343823d9a1fa9d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.864310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864141 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.864310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:44.864151 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a677ebad3cd9b5bed6441bf97d472c9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"2a677ebad3cd9b5bed6441bf97d472c9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:44.915370 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:44.915304 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:45.015965 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:45.015921 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:45.070441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:45.070399 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:46.568193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.567901 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:46.608576 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:46.608547 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:46.709007 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:46.708932 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:46.768410 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.768386 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:46.809602 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:46.809564 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:46.893173 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.893137 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 16:15:46.893696 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.893318 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:15:46.893696 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.893341 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:15:46.893696 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.893341 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:15:46.910479 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:46.910449 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:46.958125 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.958084 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:10:45 +0000 UTC" deadline="2028-03-31 08:54:43.192131734 +0000 UTC" Jul 09 16:15:46.958125 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:46.958121 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15136h38m56.234013584s" Jul 09 16:15:47.011613 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:47.011544 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:47.112190 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:47.112152 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jul 09 16:15:47.199902 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.199877 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:47.254201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.254178 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jul 09 16:15:47.259259 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:47.259215 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5e421a41c11e9140343823d9a1fa9d3.slice/crio-c37fe3a7e2d0e794b632747f9e4567e8df28a6692e408e42a382d8fcae1baa57 WatchSource:0}: Error finding container c37fe3a7e2d0e794b632747f9e4567e8df28a6692e408e42a382d8fcae1baa57: Status 404 returned error can't find the container with id c37fe3a7e2d0e794b632747f9e4567e8df28a6692e408e42a382d8fcae1baa57 Jul 09 16:15:47.259641 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:47.259628 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a677ebad3cd9b5bed6441bf97d472c9.slice/crio-50b49055d20a6011c4019f226af264a0eac22e53e312dd7bda215db8f3767c33 WatchSource:0}: Error finding container 50b49055d20a6011c4019f226af264a0eac22e53e312dd7bda215db8f3767c33: Status 404 returned error can't find the container with id 50b49055d20a6011c4019f226af264a0eac22e53e312dd7bda215db8f3767c33 Jul 09 16:15:47.262942 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.262928 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:15:47.270324 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.270306 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:15:47.271283 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.271268 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jul 09 16:15:47.279602 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.279584 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:15:47.742924 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.742851 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:47.880024 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.879991 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:47.930702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.930658 2571 apiserver.go:52] "Watching apiserver" Jul 09 16:15:47.938608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.938575 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 16:15:47.939949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.939915 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-z5wzq","openshift-ovn-kubernetes/ovnkube-node-qg8db","kube-system/global-pull-secret-syncer-spkts","kube-system/konnectivity-agent-v5bhs","kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp","openshift-cluster-node-tuning-operator/tuned-fqcs6","openshift-image-registry/node-ca-4jwb6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal","openshift-multus/multus-additional-cni-plugins-5wpt5","openshift-dns/node-resolver-ckrkq","openshift-multus/multus-tzjs8","openshift-multus/network-metrics-daemon-h84qq","openshift-network-diagnostics/network-check-target-f7kf9"] Jul 09 16:15:47.942256 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.941588 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.942881 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.942861 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:47.944456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.944434 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:47.944569 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:47.944515 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:47.944966 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.944944 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2d6p4\"" Jul 09 16:15:47.945166 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.945145 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.945393 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.945376 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.945458 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.945392 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.945634 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.945620 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.945763 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.945742 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:47.946499 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.946301 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f2vcp\"" Jul 09 16:15:47.946764 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.946656 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:47.946764 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:47.946717 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:47.948092 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.948075 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.949381 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.949364 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 16:15:47.949472 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.949410 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tjl8g\"" Jul 09 16:15:47.949575 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.949557 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 16:15:47.949986 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.949932 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:47.950339 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.950319 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.950454 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.950352 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.950853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.950700 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 16:15:47.950853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.950726 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:47.950853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.950736 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m299r\"" Jul 09 16:15:47.950853 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:47.950808 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:47.955191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.952316 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.957459 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.955541 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.957459 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.956255 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 16:15:47.957459 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.956498 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:47.957667 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.957617 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzjs8" Jul 09 16:15:47.958067 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958047 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958285 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tvqd9\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958300 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958374 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958302 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958676 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.959051 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.958860 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lj2km\"" Jul 09 16:15:47.960910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.959741 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.960910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.960398 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 16:15:47.961052 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.961015 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 16:15:47.962005 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.961589 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962162 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962464 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-x5g2b\"" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962799 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-env-overrides\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962838 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962873 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-systemd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962937 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-kubelet-config\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.962999 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-registration-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963030 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963057 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-sys\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963096 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-var-lib-kubelet\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963115 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-host\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963133 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-tmp\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963154 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67812c92-58ea-4e44-b9ba-5efb3f5a005a-serviceca\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963181 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.965725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963198 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-conf\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963224 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srm2s\" (UniqueName: \"kubernetes.io/projected/caead3c7-2459-4720-8fee-0994b9720c5e-kube-api-access-srm2s\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-netns\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-node-log\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963282 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-bin\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963301 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvgcv\" (UniqueName: \"kubernetes.io/projected/ee807b20-8366-4c74-81ca-0eb303c2109c-kube-api-access-wvgcv\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/307e2060-d541-49aa-a1ae-47566c68300e-konnectivity-ca\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963376 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963405 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963441 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee807b20-8366-4c74-81ca-0eb303c2109c-host-slash\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963471 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-systemd-units\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963497 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-log-socket\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963526 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-tuned\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963534 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963560 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-slash\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-ovn\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963619 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-script-lib\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.966603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963643 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-dbus\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963674 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/307e2060-d541-49aa-a1ae-47566c68300e-agent-certs\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963704 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-etc-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963743 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-modprobe-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963800 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-run\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963833 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbqjs\" (UniqueName: \"kubernetes.io/projected/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-kube-api-access-zbqjs\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963858 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/029f25d1-3744-4ecd-b528-1c66cdb8ec63-hosts-file\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963889 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-device-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysconfig\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963945 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963951 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963971 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-os-release\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.963993 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964015 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-lib-modules\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964035 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws2j9\" (UniqueName: \"kubernetes.io/projected/029f25d1-3744-4ecd-b528-1c66cdb8ec63-kube-api-access-ws2j9\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-socket-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964080 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964166 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl72d\" (UniqueName: \"kubernetes.io/projected/247a313f-7192-4269-881f-e1fd23dc2190-kube-api-access-wl72d\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-systemd\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964215 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964232 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964269 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-sys-fs\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964301 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-kubelet\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964603 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q9n2b\"" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-netd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964805 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-kubernetes\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964842 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88kg\" (UniqueName: \"kubernetes.io/projected/67812c92-58ea-4e44-b9ba-5efb3f5a005a-kube-api-access-q88kg\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964865 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-config\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964903 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-system-cni-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964936 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.964969 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67812c92-58ea-4e44-b9ba-5efb3f5a005a-host\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965001 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjhmc\" (UniqueName: \"kubernetes.io/projected/59a6b722-697b-48eb-868c-874ce847a050-kube-api-access-mjhmc\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965031 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjfh\" (UniqueName: \"kubernetes.io/projected/f64a4a0d-800a-4daa-b045-5a83fed98bfd-kube-api-access-6bjfh\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965058 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-cnibin\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.967825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965123 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee807b20-8366-4c74-81ca-0eb303c2109c-iptables-alerter-script\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965167 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965215 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/029f25d1-3744-4ecd-b528-1c66cdb8ec63-tmp-dir\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965252 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965413 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-var-lib-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965488 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dgcfw\"" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965664 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 16:15:47.968594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.965693 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 16:15:47.969119 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.969060 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:15:47.986638 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.986615 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9jp2w" Jul 09 16:15:47.994741 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:47.994692 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9jp2w" Jul 09 16:15:48.055414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.055391 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 16:15:48.066547 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066521 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-systemd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.066649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066561 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.066649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066626 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.066649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066627 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-systemd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066659 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-kubelet-config\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066686 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-os-release\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066704 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-kubelet-config\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066723 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-socket-dir-parent\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-bin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-registration-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.066839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066821 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066848 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-sys\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-var-lib-kubelet\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066890 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-host\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066902 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-registration-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066910 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-tmp\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066944 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67812c92-58ea-4e44-b9ba-5efb3f5a005a-serviceca\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066969 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.066992 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-conf\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srm2s\" (UniqueName: \"kubernetes.io/projected/caead3c7-2459-4720-8fee-0994b9720c5e-kube-api-access-srm2s\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067041 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-netns\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067062 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-node-log\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067086 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-bin\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067114 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-k8s-cni-cncf-io\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067140 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvgcv\" (UniqueName: \"kubernetes.io/projected/ee807b20-8366-4c74-81ca-0eb303c2109c-kube-api-access-wvgcv\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067165 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/307e2060-d541-49aa-a1ae-47566c68300e-konnectivity-ca\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.067267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067212 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067224 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-netns\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067216 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067249 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7qr6\" (UniqueName: \"kubernetes.io/projected/44742e7f-8298-4d4a-a2ba-52dcc66210ca-kube-api-access-s7qr6\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee807b20-8366-4c74-81ca-0eb303c2109c-host-slash\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067296 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-systemd-units\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-log-socket\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067342 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-tuned\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067370 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-slash\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-ovn\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067427 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-script-lib\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067450 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-dbus\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-multus\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067495 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-netns\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067533 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/307e2060-d541-49aa-a1ae-47566c68300e-agent-certs\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067553 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-etc-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067568 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-modprobe-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067598 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-run\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.067989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067612 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbqjs\" (UniqueName: \"kubernetes.io/projected/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-kube-api-access-zbqjs\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/029f25d1-3744-4ecd-b528-1c66cdb8ec63-hosts-file\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067639 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67812c92-58ea-4e44-b9ba-5efb3f5a005a-serviceca\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067649 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-device-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067663 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysconfig\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067678 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067689 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cnibin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067785 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-sys\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067797 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-conf\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.067856 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-host\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068024 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-var-lib-kubelet\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068067 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-node-log\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068115 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-bin\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068118 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068225 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/149f66fa-fa61-4a94-9440-52f6822c33df-dbus\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068438 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-script-lib\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068501 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/029f25d1-3744-4ecd-b528-1c66cdb8ec63-hosts-file\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.068525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068531 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-etc-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068616 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-modprobe-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068620 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-systemd-units\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068662 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-run\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068727 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysctl-d\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068805 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee807b20-8366-4c74-81ca-0eb303c2109c-host-slash\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068831 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/307e2060-d541-49aa-a1ae-47566c68300e-konnectivity-ca\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068858 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-slash\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068877 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-run-ovn\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068909 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-log-socket\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.068964 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069003 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-sysconfig\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.068964 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-device-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cni-binary-copy\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069123 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-conf-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.069232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069149 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-etc-kubernetes\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.069242 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:15:48.569201172 +0000 UTC m=+2.957683546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069265 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-os-release\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069316 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069346 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-lib-modules\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069370 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069393 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws2j9\" (UniqueName: \"kubernetes.io/projected/029f25d1-3744-4ecd-b528-1c66cdb8ec63-kube-api-access-ws2j9\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-socket-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069433 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-os-release\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069449 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069473 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wl72d\" (UniqueName: \"kubernetes.io/projected/247a313f-7192-4269-881f-e1fd23dc2190-kube-api-access-wl72d\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069495 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-systemd\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069518 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-kubelet\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069546 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069569 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-sys-fs\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-kubelet\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.069722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069614 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-netd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069639 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-daemon-config\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-kubernetes\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069693 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q88kg\" (UniqueName: \"kubernetes.io/projected/67812c92-58ea-4e44-b9ba-5efb3f5a005a-kube-api-access-q88kg\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069715 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-config\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069750 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-system-cni-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069815 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-hostroot\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069836 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67812c92-58ea-4e44-b9ba-5efb3f5a005a-host\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjhmc\" (UniqueName: \"kubernetes.io/projected/59a6b722-697b-48eb-868c-874ce847a050-kube-api-access-mjhmc\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069904 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjfh\" (UniqueName: \"kubernetes.io/projected/f64a4a0d-800a-4daa-b045-5a83fed98bfd-kube-api-access-6bjfh\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-cnibin\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069960 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.069983 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-multus-certs\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070027 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee807b20-8366-4c74-81ca-0eb303c2109c-iptables-alerter-script\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070145 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-socket-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/029f25d1-3744-4ecd-b528-1c66cdb8ec63-tmp-dir\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.070267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070241 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070268 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-var-lib-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070295 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-env-overrides\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070322 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070331 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-binary-copy\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070339 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-lib-modules\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070347 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-system-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070373 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070401 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-var-lib-openvswitch\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070496 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-tmp\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070519 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee807b20-8366-4c74-81ca-0eb303c2109c-iptables-alerter-script\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070536 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.070503 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070601 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-systemd\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.070612 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:15:48.570594312 +0000 UTC m=+2.959076679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070730 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/029f25d1-3744-4ecd-b528-1c66cdb8ec63-tmp-dir\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070798 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-run-ovn-kubernetes\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070808 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-sys-fs\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070844 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-kubelet\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070880 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67812c92-58ea-4e44-b9ba-5efb3f5a005a-host\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070904 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f64a4a0d-800a-4daa-b045-5a83fed98bfd-host-cni-netd\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.070952 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-system-cni-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071008 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-env-overrides\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071012 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-cnibin\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071157 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/247a313f-7192-4269-881f-e1fd23dc2190-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071213 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-kubernetes\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071281 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/247a313f-7192-4269-881f-e1fd23dc2190-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071305 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/caead3c7-2459-4720-8fee-0994b9720c5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.071817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.071328 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovnkube-config\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.072334 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.072252 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/307e2060-d541-49aa-a1ae-47566c68300e-agent-certs\") pod \"konnectivity-agent-v5bhs\" (UID: \"307e2060-d541-49aa-a1ae-47566c68300e\") " pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:48.073989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.073958 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f64a4a0d-800a-4daa-b045-5a83fed98bfd-ovn-node-metrics-cert\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.074700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.074666 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-etc-tuned\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.078934 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.078352 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:15:48.078934 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.078376 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:15:48.078934 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.078389 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:48.078934 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.078439 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:15:48.57842397 +0000 UTC m=+2.966906353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:48.081399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.081369 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srm2s\" (UniqueName: \"kubernetes.io/projected/caead3c7-2459-4720-8fee-0994b9720c5e-kube-api-access-srm2s\") pod \"aws-ebs-csi-driver-node-xpwsp\" (UID: \"caead3c7-2459-4720-8fee-0994b9720c5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.083247 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.083213 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws2j9\" (UniqueName: \"kubernetes.io/projected/029f25d1-3744-4ecd-b528-1c66cdb8ec63-kube-api-access-ws2j9\") pod \"node-resolver-ckrkq\" (UID: \"029f25d1-3744-4ecd-b528-1c66cdb8ec63\") " pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.084089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.084045 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvgcv\" (UniqueName: \"kubernetes.io/projected/ee807b20-8366-4c74-81ca-0eb303c2109c-kube-api-access-wvgcv\") pod \"iptables-alerter-z5wzq\" (UID: \"ee807b20-8366-4c74-81ca-0eb303c2109c\") " pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.084854 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.084576 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbqjs\" (UniqueName: \"kubernetes.io/projected/b0ab3d79-9814-46b6-9f8d-e580e1d5b170-kube-api-access-zbqjs\") pod \"tuned-fqcs6\" (UID: \"b0ab3d79-9814-46b6-9f8d-e580e1d5b170\") " pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.084854 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.084653 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88kg\" (UniqueName: \"kubernetes.io/projected/67812c92-58ea-4e44-b9ba-5efb3f5a005a-kube-api-access-q88kg\") pod \"node-ca-4jwb6\" (UID: \"67812c92-58ea-4e44-b9ba-5efb3f5a005a\") " pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.084854 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.084809 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjhmc\" (UniqueName: \"kubernetes.io/projected/59a6b722-697b-48eb-868c-874ce847a050-kube-api-access-mjhmc\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:48.085146 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.085126 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl72d\" (UniqueName: \"kubernetes.io/projected/247a313f-7192-4269-881f-e1fd23dc2190-kube-api-access-wl72d\") pod \"multus-additional-cni-plugins-5wpt5\" (UID: \"247a313f-7192-4269-881f-e1fd23dc2190\") " pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.086160 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.086130 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjfh\" (UniqueName: \"kubernetes.io/projected/f64a4a0d-800a-4daa-b045-5a83fed98bfd-kube-api-access-6bjfh\") pod \"ovnkube-node-qg8db\" (UID: \"f64a4a0d-800a-4daa-b045-5a83fed98bfd\") " pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.139663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.139602 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"2a677ebad3cd9b5bed6441bf97d472c9","Type":"ContainerStarted","Data":"50b49055d20a6011c4019f226af264a0eac22e53e312dd7bda215db8f3767c33"} Jul 09 16:15:48.140967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.140935 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" event={"ID":"a5e421a41c11e9140343823d9a1fa9d3","Type":"ContainerStarted","Data":"c37fe3a7e2d0e794b632747f9e4567e8df28a6692e408e42a382d8fcae1baa57"} Jul 09 16:15:48.171669 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171635 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-bin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171685 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-k8s-cni-cncf-io\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171716 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7qr6\" (UniqueName: \"kubernetes.io/projected/44742e7f-8298-4d4a-a2ba-52dcc66210ca-kube-api-access-s7qr6\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171741 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-multus\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171762 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-netns\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171786 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-bin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171827 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cnibin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171849 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cni-binary-copy\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171857 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-cni-multus\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.171873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-conf-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171893 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-etc-kubernetes\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171902 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-k8s-cni-cncf-io\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171916 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171948 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-kubelet\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.171984 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-daemon-config\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172012 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-hostroot\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172042 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-multus-certs\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172071 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-system-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172075 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-netns\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172119 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-os-release\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172138 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-socket-dir-parent\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172144 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-system-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172192 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-conf-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172223 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-os-release\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172238 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-socket-dir-parent\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.172301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172276 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-etc-kubernetes\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172312 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-var-lib-kubelet\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172365 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-cni-dir\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172408 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cnibin\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172420 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-cni-binary-copy\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172447 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-hostroot\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172467 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44742e7f-8298-4d4a-a2ba-52dcc66210ca-host-run-multus-certs\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.173063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.172710 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44742e7f-8298-4d4a-a2ba-52dcc66210ca-multus-daemon-config\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.182561 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.182505 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7qr6\" (UniqueName: \"kubernetes.io/projected/44742e7f-8298-4d4a-a2ba-52dcc66210ca-kube-api-access-s7qr6\") pod \"multus-tzjs8\" (UID: \"44742e7f-8298-4d4a-a2ba-52dcc66210ca\") " pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.261652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.261569 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" Jul 09 16:15:48.270940 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.270908 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ab3d79_9814_46b6_9f8d_e580e1d5b170.slice/crio-1b93adc128f0d3c559e0ad08e15e330a503e8a6136cd8b37df6f5af604e94e63 WatchSource:0}: Error finding container 1b93adc128f0d3c559e0ad08e15e330a503e8a6136cd8b37df6f5af604e94e63: Status 404 returned error can't find the container with id 1b93adc128f0d3c559e0ad08e15e330a503e8a6136cd8b37df6f5af604e94e63 Jul 09 16:15:48.273901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.273660 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ckrkq" Jul 09 16:15:48.283691 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.283664 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:15:48.284174 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.284144 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029f25d1_3744_4ecd_b528_1c66cdb8ec63.slice/crio-da97b759ce59c8b4042444f6d291eaeb66d8c7a7faa3b1843716a483df9be9ec WatchSource:0}: Error finding container da97b759ce59c8b4042444f6d291eaeb66d8c7a7faa3b1843716a483df9be9ec: Status 404 returned error can't find the container with id da97b759ce59c8b4042444f6d291eaeb66d8c7a7faa3b1843716a483df9be9ec Jul 09 16:15:48.291467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.291262 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" Jul 09 16:15:48.294715 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.294678 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307e2060_d541_49aa_a1ae_47566c68300e.slice/crio-eb5ec689ab0d20b9bb0d47718895ed55bb14cefaac08ed95e2a37c54e596380d WatchSource:0}: Error finding container eb5ec689ab0d20b9bb0d47718895ed55bb14cefaac08ed95e2a37c54e596380d: Status 404 returned error can't find the container with id eb5ec689ab0d20b9bb0d47718895ed55bb14cefaac08ed95e2a37c54e596380d Jul 09 16:15:48.300545 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.300505 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4jwb6" Jul 09 16:15:48.301021 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.300995 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaead3c7_2459_4720_8fee_0994b9720c5e.slice/crio-7007b050c7c51f8f29657b89acc8c20efe1e53015932e622323c7ea6235a072e WatchSource:0}: Error finding container 7007b050c7c51f8f29657b89acc8c20efe1e53015932e622323c7ea6235a072e: Status 404 returned error can't find the container with id 7007b050c7c51f8f29657b89acc8c20efe1e53015932e622323c7ea6235a072e Jul 09 16:15:48.307816 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.307794 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:15:48.310074 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.309889 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67812c92_58ea_4e44_b9ba_5efb3f5a005a.slice/crio-888dd1815425c411eb9b35da77573009473a4cd84bb8dd08b345bb1143f43aba WatchSource:0}: Error finding container 888dd1815425c411eb9b35da77573009473a4cd84bb8dd08b345bb1143f43aba: Status 404 returned error can't find the container with id 888dd1815425c411eb9b35da77573009473a4cd84bb8dd08b345bb1143f43aba Jul 09 16:15:48.315328 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.315308 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" Jul 09 16:15:48.316054 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.316028 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64a4a0d_800a_4daa_b045_5a83fed98bfd.slice/crio-57bf0aa3073be14f59c2c28b6499426d5b60ae28ee14634235b04bb9bedbf950 WatchSource:0}: Error finding container 57bf0aa3073be14f59c2c28b6499426d5b60ae28ee14634235b04bb9bedbf950: Status 404 returned error can't find the container with id 57bf0aa3073be14f59c2c28b6499426d5b60ae28ee14634235b04bb9bedbf950 Jul 09 16:15:48.325858 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.325834 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247a313f_7192_4269_881f_e1fd23dc2190.slice/crio-688c709500f9ce124e19d3b37c5bcb5b0841ed8755decbdc970931a8d6a75ac8 WatchSource:0}: Error finding container 688c709500f9ce124e19d3b37c5bcb5b0841ed8755decbdc970931a8d6a75ac8: Status 404 returned error can't find the container with id 688c709500f9ce124e19d3b37c5bcb5b0841ed8755decbdc970931a8d6a75ac8 Jul 09 16:15:48.326765 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.326752 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z5wzq" Jul 09 16:15:48.332976 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.332945 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tzjs8" Jul 09 16:15:48.335521 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.335494 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee807b20_8366_4c74_81ca_0eb303c2109c.slice/crio-9896e66ba670995e4c036ccd7f29de18e61d871f003852dc5d9b3811a70a3a91 WatchSource:0}: Error finding container 9896e66ba670995e4c036ccd7f29de18e61d871f003852dc5d9b3811a70a3a91: Status 404 returned error can't find the container with id 9896e66ba670995e4c036ccd7f29de18e61d871f003852dc5d9b3811a70a3a91 Jul 09 16:15:48.341694 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:15:48.341667 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44742e7f_8298_4d4a_a2ba_52dcc66210ca.slice/crio-c166d752e9a0225bb3a1233ae4050d3446b06f1d616182077523ee21a5215da8 WatchSource:0}: Error finding container c166d752e9a0225bb3a1233ae4050d3446b06f1d616182077523ee21a5215da8: Status 404 returned error can't find the container with id c166d752e9a0225bb3a1233ae4050d3446b06f1d616182077523ee21a5215da8 Jul 09 16:15:48.574729 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.574590 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:48.574729 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.574706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:48.574988 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.574752 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:48.574988 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.574824 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:48.574988 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.574843 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:15:49.574822442 +0000 UTC m=+3.963304831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:48.574988 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.574885 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:15:49.574868154 +0000 UTC m=+3.963350520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:48.675380 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.675338 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:48.675542 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.675504 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:15:48.675542 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.675532 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:15:48.675621 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.675545 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:48.675621 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:48.675599 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:15:49.67558309 +0000 UTC m=+4.064065485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:48.997134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.997089 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:10:47 +0000 UTC" deadline="2028-02-14 23:52:16.536200983 +0000 UTC" Jul 09 16:15:48.997134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:48.997130 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14047h36m27.53907549s" Jul 09 16:15:49.129885 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.129764 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:49.130033 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.129915 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:49.130344 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.130324 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:49.130499 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.130466 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:49.145493 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.145358 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzjs8" event={"ID":"44742e7f-8298-4d4a-a2ba-52dcc66210ca","Type":"ContainerStarted","Data":"c166d752e9a0225bb3a1233ae4050d3446b06f1d616182077523ee21a5215da8"} Jul 09 16:15:49.147386 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.147360 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5wzq" event={"ID":"ee807b20-8366-4c74-81ca-0eb303c2109c","Type":"ContainerStarted","Data":"9896e66ba670995e4c036ccd7f29de18e61d871f003852dc5d9b3811a70a3a91"} Jul 09 16:15:49.148884 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.148862 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerStarted","Data":"688c709500f9ce124e19d3b37c5bcb5b0841ed8755decbdc970931a8d6a75ac8"} Jul 09 16:15:49.150328 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.150304 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jwb6" event={"ID":"67812c92-58ea-4e44-b9ba-5efb3f5a005a","Type":"ContainerStarted","Data":"888dd1815425c411eb9b35da77573009473a4cd84bb8dd08b345bb1143f43aba"} Jul 09 16:15:49.151698 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.151673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" event={"ID":"caead3c7-2459-4720-8fee-0994b9720c5e","Type":"ContainerStarted","Data":"7007b050c7c51f8f29657b89acc8c20efe1e53015932e622323c7ea6235a072e"} Jul 09 16:15:49.152975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.152950 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ckrkq" event={"ID":"029f25d1-3744-4ecd-b528-1c66cdb8ec63","Type":"ContainerStarted","Data":"da97b759ce59c8b4042444f6d291eaeb66d8c7a7faa3b1843716a483df9be9ec"} Jul 09 16:15:49.155367 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.155340 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"57bf0aa3073be14f59c2c28b6499426d5b60ae28ee14634235b04bb9bedbf950"} Jul 09 16:15:49.157451 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.157426 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v5bhs" event={"ID":"307e2060-d541-49aa-a1ae-47566c68300e","Type":"ContainerStarted","Data":"eb5ec689ab0d20b9bb0d47718895ed55bb14cefaac08ed95e2a37c54e596380d"} Jul 09 16:15:49.159143 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.159120 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" event={"ID":"b0ab3d79-9814-46b6-9f8d-e580e1d5b170","Type":"ContainerStarted","Data":"1b93adc128f0d3c559e0ad08e15e330a503e8a6136cd8b37df6f5af604e94e63"} Jul 09 16:15:49.582871 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.582789 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:49.582871 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.582863 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:49.583099 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.582992 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:49.583099 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.583051 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:15:51.583030813 +0000 UTC m=+5.971513194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:49.583449 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.583428 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:49.583532 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.583487 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:15:51.583470762 +0000 UTC m=+5.971953152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:49.643332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.643301 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:15:49.683739 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.683691 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:49.683912 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.683899 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:15:49.683971 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.683919 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:15:49.683971 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.683931 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:49.684121 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:49.683987 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:15:51.683967789 +0000 UTC m=+6.072450175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:49.997618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.997514 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:10:47 +0000 UTC" deadline="2027-12-28 17:52:46.295153584 +0000 UTC" Jul 09 16:15:49.998179 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:49.998153 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12889h36m56.297010293s" Jul 09 16:15:50.130182 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:50.130147 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:50.130356 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:50.130294 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:51.130205 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:51.129299 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:51.130205 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.129452 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:51.130205 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:51.129900 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:51.130205 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.129992 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:51.600992 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:51.600876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:51.600992 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:51.600972 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:51.601179 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.601118 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:51.601219 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.601198 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:15:55.601161009 +0000 UTC m=+9.989643388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:51.601590 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.601570 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:51.601672 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.601620 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:15:55.601610055 +0000 UTC m=+9.990092422 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:51.701392 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:51.701348 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:51.701578 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.701516 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:15:51.701578 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.701538 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:15:51.701578 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.701552 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:51.701750 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:51.701614 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:15:55.701595226 +0000 UTC m=+10.090077595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:52.130921 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:52.130891 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:52.131368 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:52.131048 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:53.130535 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:53.129995 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:53.130535 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:53.130121 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:53.130535 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:53.130431 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:53.130535 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:53.130495 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:54.129867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:54.129128 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:54.129867 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:54.129474 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:55.129928 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:55.129892 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:55.130399 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.130042 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:55.130399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:55.130133 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:55.130399 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.130221 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:55.636124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:55.635960 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:55.636124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:55.636048 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:55.636337 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.636134 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:55.636337 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.636209 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:55.636337 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.636216 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:03.636194611 +0000 UTC m=+18.024676980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:15:55.636337 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.636293 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:16:03.636274649 +0000 UTC m=+18.024757022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:15:55.736948 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:55.736911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:55.737114 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.737078 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:15:55.737114 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.737102 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:15:55.737114 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.737116 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:55.737277 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:55.737173 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:16:03.737154036 +0000 UTC m=+18.125636409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:15:56.130118 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:56.130087 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:56.130494 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:56.130186 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:57.129333 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:57.129279 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:57.129513 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:57.129337 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:57.129513 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:57.129454 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:15:57.129630 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:57.129577 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:58.130171 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:58.130134 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:15:58.130657 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:58.130265 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:15:59.129685 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:59.129652 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:15:59.129862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:15:59.129664 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:15:59.129862 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:59.129803 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:15:59.129959 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:15:59.129911 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:00.129875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:00.129797 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:00.130292 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:00.129927 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:00.185408 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:00.185250 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" event={"ID":"b0ab3d79-9814-46b6-9f8d-e580e1d5b170","Type":"ContainerStarted","Data":"4cacd7976a95651d94c244d11142fc1d31c682d2601c18d9b714994794ea58ca"} Jul 09 16:16:00.189671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:00.189300 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" event={"ID":"a5e421a41c11e9140343823d9a1fa9d3","Type":"ContainerStarted","Data":"28c342abadaf46094740920dcab7441112dede19df48996af701144b3359521e"} Jul 09 16:16:00.205197 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:00.205133 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fqcs6" podStartSLOduration=3.311757745 podStartE2EDuration="14.205117799s" totalImagesPullingTime="10.893360054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:00.205116852 +0000 UTC m=+14.593599242" watchObservedRunningTime="2026-07-09 16:16:00.205117799 +0000 UTC m=+14.593600188" Jul 09 16:16:00.224386 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:00.224328 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" podStartSLOduration=13.22430587 podStartE2EDuration="13.22430587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:00.223890026 +0000 UTC m=+14.612372416" watchObservedRunningTime="2026-07-09 16:16:00.22430587 +0000 UTC m=+14.612788260" Jul 09 16:16:01.129553 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.129363 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:01.129742 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.129394 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:01.129742 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:01.129677 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:01.129742 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:01.129732 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:01.193388 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.193342 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v5bhs" event={"ID":"307e2060-d541-49aa-a1ae-47566c68300e","Type":"ContainerStarted","Data":"489d105f75704cc9c032aa5b6c4c1b127da629da5094a08604f1be940e4ada68"} Jul 09 16:16:01.195185 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.195156 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"2a677ebad3cd9b5bed6441bf97d472c9","Type":"ContainerStarted","Data":"d6479816f865f668732163cd011781735fbce64057a513843c28ea16f449405c"} Jul 09 16:16:01.197585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.197559 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z5wzq" event={"ID":"ee807b20-8366-4c74-81ca-0eb303c2109c","Type":"ContainerStarted","Data":"b36d2f9e39721b626a849b5bdcd36f9e491730383377d6d90ca490459ad62e04"} Jul 09 16:16:01.199158 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.199134 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerStarted","Data":"098e07c3e9ef7e3fdaa561d2d7497276d7b19f5aff82e8f86b59f2db587a8ff5"} Jul 09 16:16:01.201104 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.200749 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4jwb6" event={"ID":"67812c92-58ea-4e44-b9ba-5efb3f5a005a","Type":"ContainerStarted","Data":"5f3670604509c2a083e9a3f259df53a4e9593b00bea400c34d275acb6106abe8"} Jul 09 16:16:01.202631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.202600 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" event={"ID":"caead3c7-2459-4720-8fee-0994b9720c5e","Type":"ContainerStarted","Data":"fbf97367c7d5eeb776a74a24f1fc58f6ca6406560b91a775c02093b6288b3a75"} Jul 09 16:16:01.204325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.204302 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ckrkq" event={"ID":"029f25d1-3744-4ecd-b528-1c66cdb8ec63","Type":"ContainerStarted","Data":"8392061bf355089ffc8c60e7cb018d270fa45b7e6b37f45ac523a40c0ff3e2c8"} Jul 09 16:16:01.209055 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.209008 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v5bhs" podStartSLOduration=4.828332001 podStartE2EDuration="15.208990266s" totalImagesPullingTime="10.380658265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:01.208437333 +0000 UTC m=+15.596919721" watchObservedRunningTime="2026-07-09 16:16:01.208990266 +0000 UTC m=+15.597472658" Jul 09 16:16:01.246226 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.246167 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z5wzq" podStartSLOduration=4.434240319 podStartE2EDuration="15.246146397s" totalImagesPullingTime="10.811906078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:01.245682909 +0000 UTC m=+15.634165299" watchObservedRunningTime="2026-07-09 16:16:01.246146397 +0000 UTC m=+15.634628787" Jul 09 16:16:01.260528 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.260469 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ckrkq" podStartSLOduration=4.39830198 podStartE2EDuration="15.260451121s" totalImagesPullingTime="10.862149141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:01.260353969 +0000 UTC m=+15.648836359" watchObservedRunningTime="2026-07-09 16:16:01.260451121 +0000 UTC m=+15.648933511" Jul 09 16:16:01.275535 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.275478 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4jwb6" podStartSLOduration=4.544609681 podStartE2EDuration="15.275458936s" totalImagesPullingTime="10.730849255s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:01.275435539 +0000 UTC m=+15.663917930" watchObservedRunningTime="2026-07-09 16:16:01.275458936 +0000 UTC m=+15.663941308" Jul 09 16:16:01.362061 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.361998 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:01.437316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:01.437228 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:02.130219 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:02.130177 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:02.130389 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:02.130327 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:03.129891 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.129855 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:03.129891 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.129873 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:03.130538 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.130002 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:03.130538 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.130397 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:03.699446 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.699402 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:03.699610 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.699459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:03.699610 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.699565 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:16:03.699610 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.699583 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:16:03.699804 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.699640 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:19.699622744 +0000 UTC m=+34.088105124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:16:03.699804 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.699655 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:16:19.699648787 +0000 UTC m=+34.088131154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:16:03.755618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.755580 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:16:03.756257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.756237 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:16:03.800719 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.800688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:03.800913 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.800893 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:16:03.800968 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.800924 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:16:03.800968 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.800937 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:16:03.801055 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:03.801006 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:16:19.800986416 +0000 UTC m=+34.189468787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:16:03.848104 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.848072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:03.911090 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:03.911055 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.034140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.034052 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.088324 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.088295 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.130020 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.129984 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:04.130624 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:04.130513 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:04.213841 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.213798 2571 generic.go:356] "Generic (PLEG): container finished" podID="2a677ebad3cd9b5bed6441bf97d472c9" containerID="d6479816f865f668732163cd011781735fbce64057a513843c28ea16f449405c" exitCode=0 Jul 09 16:16:04.213841 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.213813 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"2a677ebad3cd9b5bed6441bf97d472c9","Type":"ContainerDied","Data":"d6479816f865f668732163cd011781735fbce64057a513843c28ea16f449405c"} Jul 09 16:16:04.215632 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.215608 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="098e07c3e9ef7e3fdaa561d2d7497276d7b19f5aff82e8f86b59f2db587a8ff5" exitCode=0 Jul 09 16:16:04.215732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.215660 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"098e07c3e9ef7e3fdaa561d2d7497276d7b19f5aff82e8f86b59f2db587a8ff5"} Jul 09 16:16:04.263085 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.263045 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.315874 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.315792 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.494953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.494916 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.597853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.597760 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.698050 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.698013 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.766574 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.766529 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.875217 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.875145 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:04.974889 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:04.974860 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:05.075761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:05.075731 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ckrkq_029f25d1-3744-4ecd-b528-1c66cdb8ec63/dns-node-resolver/0.log" Jul 09 16:16:05.077311 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:05.077282 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:05.129762 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:05.129679 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:05.129923 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:05.129813 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:05.129923 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:05.129858 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:05.130029 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:05.129967 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:06.074812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:06.074790 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jwb6_67812c92-58ea-4e44-b9ba-5efb3f5a005a/node-ca/0.log" Jul 09 16:16:06.132046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:06.132017 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:06.132176 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:06.132122 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:06.610891 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:06.610859 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:06.676921 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:06.676890 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:07.129341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:07.129305 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:07.129822 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:07.129309 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:07.129822 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:07.129435 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:07.129822 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:07.129540 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:07.653230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:07.653193 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:08.133007 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.132930 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:08.133489 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:08.133062 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:08.428757 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.428721 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:08.638748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.638566 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:08.701005 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.700809 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 16:16:08.744072 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.744040 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:08.843680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:08.843648 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:09.031417 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.031112 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:16:08.700828804Z","UUID":"8de882b0-521d-431a-806a-50aa182f1403","Handler":null,"Name":"","Endpoint":""} Jul 09 16:16:09.032655 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.032633 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 16:16:09.032790 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.032678 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 16:16:09.112746 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.112710 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:09.129690 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.129659 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:09.129690 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.129692 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:09.129990 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:09.129801 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:09.129990 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:09.129877 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:09.231224 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.231135 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"2a677ebad3cd9b5bed6441bf97d472c9","Type":"ContainerStarted","Data":"0ce77dcb615e7e0c9971231ebb410bb8326921f8e45f42a0279777b00461dd54"} Jul 09 16:16:09.232908 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.232876 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tzjs8" event={"ID":"44742e7f-8298-4d4a-a2ba-52dcc66210ca","Type":"ContainerStarted","Data":"2d13dccabe6afb4bda8772b1712107394933ef1f3af098bef6e4fd8a2548a4dd"} Jul 09 16:16:09.235132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.235102 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" event={"ID":"caead3c7-2459-4720-8fee-0994b9720c5e","Type":"ContainerStarted","Data":"c5270be4b6ef84f5cdfc702d989bfc5a74d9e4960cf200a42883a760a493eec7"} Jul 09 16:16:09.241109 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241081 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:16:09.241495 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241473 2571 generic.go:356] "Generic (PLEG): container finished" podID="f64a4a0d-800a-4daa-b045-5a83fed98bfd" containerID="8a7d0bab08cd0a8b1c41a4e709d9755d9dd7f6c78434517e7e4c851a90bac0b9" exitCode=1 Jul 09 16:16:09.241602 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241560 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"141757c12448dba0fdb735c234e9a08bc8580fc156fad756e1e554a1398d8617"} Jul 09 16:16:09.241663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241650 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"89815834dfb39d4d5d67fb29dad2022a7889f0ee43bc250770bbf1f427b535cb"} Jul 09 16:16:09.241734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241694 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"9e4521f432d1ebd32c4987587194bd764e5409293a290cf6346f3cf1360224f0"} Jul 09 16:16:09.241810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241736 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"18b16fb2dd84397513cc37e7ae7d23d76d264075bc2a6e9a0777f74d1cd78c52"} Jul 09 16:16:09.241810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241765 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerDied","Data":"8a7d0bab08cd0a8b1c41a4e709d9755d9dd7f6c78434517e7e4c851a90bac0b9"} Jul 09 16:16:09.241905 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.241815 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"6a418eee46caf1abc91987148eb3c5be9a34ba01c3b99665253c45024db7fe72"} Jul 09 16:16:09.248829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.248755 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" podStartSLOduration=22.248736909 podStartE2EDuration="22.248736909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:09.248184918 +0000 UTC m=+23.636667310" watchObservedRunningTime="2026-07-09 16:16:09.248736909 +0000 UTC m=+23.637219301" Jul 09 16:16:09.271079 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:09.271018 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tzjs8" podStartSLOduration=3.062309293 podStartE2EDuration="23.27100027s" totalImagesPullingTime="20.208690977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:09.270541426 +0000 UTC m=+23.659023817" watchObservedRunningTime="2026-07-09 16:16:09.27100027 +0000 UTC m=+23.659482697" Jul 09 16:16:10.132541 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.132512 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:10.132731 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:10.132608 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:10.247003 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.246900 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" event={"ID":"caead3c7-2459-4720-8fee-0994b9720c5e","Type":"ContainerStarted","Data":"68fbb8602e3cd9e2dc86b7a4c38700e0940c963d9a5bae5714ea81f00db7a925"} Jul 09 16:16:10.310163 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.310126 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:10.496929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.496901 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:10.717388 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.717312 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:10.894357 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:10.894328 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:11.102257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.102153 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:11.130630 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.130138 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:11.130630 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.130162 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:11.130630 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:11.130283 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:11.130630 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:11.130404 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:11.207675 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.207645 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:11.252167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.252144 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:16:11.252661 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:11.252550 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"faa58320a8e0a746c286caf31ab4a105115e50138d96902e1f2939c0bb23b033"} Jul 09 16:16:12.019088 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.019050 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.119603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.119572 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.129975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.129947 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:12.130138 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:12.130057 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:12.218590 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.218558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.499596 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.499521 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.714880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.714846 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.897068 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.896990 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:12.960734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:12.960700 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:13.096334 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:13.096298 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:13.129584 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:13.129548 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:13.129764 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:13.129702 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:13.129764 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:13.129716 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:13.129898 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:13.129846 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:13.953248 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:13.953223 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.009888 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.009626 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.132613 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.132590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:14.132787 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:14.132684 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:14.260130 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.260094 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerStarted","Data":"4fa48bd5c7fff62df26c7b216b380ac0bbf84b81a8e5d3ea5f3199369521663f"} Jul 09 16:16:14.263408 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.263385 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:16:14.263735 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.263717 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"8527ee9e2c5811efe2b163c47843a76a5bc6cef5e6c8636c20587694ad16b8f2"} Jul 09 16:16:14.263984 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.263955 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:14.264092 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.264034 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:14.264152 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.264131 2571 scope.go:117] "RemoveContainer" containerID="8a7d0bab08cd0a8b1c41a4e709d9755d9dd7f6c78434517e7e4c851a90bac0b9" Jul 09 16:16:14.279451 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.279427 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:14.286335 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.286293 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xpwsp" podStartSLOduration=7.857149101 podStartE2EDuration="28.286277045s" totalImagesPullingTime="20.429127944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:10.280557668 +0000 UTC m=+24.669040057" watchObservedRunningTime="2026-07-09 16:16:14.286277045 +0000 UTC m=+28.674759449" Jul 09 16:16:14.296912 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.296885 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.493885 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.493808 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.560952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.560922 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:16:14.561114 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.561042 2571 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 16:16:14.561481 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.561468 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v5bhs" Jul 09 16:16:14.694826 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.694793 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.794831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.794733 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:14.894870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:14.894841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:15.090254 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.090164 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:15.129399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.129360 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:15.129588 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.129360 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:15.129588 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:15.129477 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:15.129678 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:15.129583 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:15.267930 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.267893 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="4fa48bd5c7fff62df26c7b216b380ac0bbf84b81a8e5d3ea5f3199369521663f" exitCode=0 Jul 09 16:16:15.268105 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.267956 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"4fa48bd5c7fff62df26c7b216b380ac0bbf84b81a8e5d3ea5f3199369521663f"} Jul 09 16:16:15.271642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.271622 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:16:15.271997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.271973 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" event={"ID":"f64a4a0d-800a-4daa-b045-5a83fed98bfd","Type":"ContainerStarted","Data":"81371f37573007f8327b0b6769425f3be19bc319f4939cdcb1c59b4151998c8c"} Jul 09 16:16:15.272344 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.272316 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:15.288251 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.288229 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:15.316218 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.316169 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" podStartSLOduration=9.08066762 podStartE2EDuration="29.316152974s" totalImagesPullingTime="20.235485354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:15.314609241 +0000 UTC m=+29.703091629" watchObservedRunningTime="2026-07-09 16:16:15.316152974 +0000 UTC m=+29.704635362" Jul 09 16:16:15.890930 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:15.890895 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:16.133230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:16.133200 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:16.133706 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:16.133312 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:16.571188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:16.571161 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:16.699357 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:16.699273 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:17.093691 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.093609 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:17.129925 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.129899 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:17.130038 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:17.130012 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:17.130081 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.130068 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:17.130185 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:17.130167 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:17.278940 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.278903 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="9034e4713d30ab8a550c3bd01052317196dae019eb5a7aa4b1a23fc463683aee" exitCode=0 Jul 09 16:16:17.279387 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.278977 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"9034e4713d30ab8a550c3bd01052317196dae019eb5a7aa4b1a23fc463683aee"} Jul 09 16:16:17.306246 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.306203 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:17.365247 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.365178 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:17.687993 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:17.687914 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:18.129666 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:18.129584 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:18.129851 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:18.129742 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:18.492914 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:18.492855 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:18.693815 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:18.693785 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:18.892540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:18.892459 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:19.103597 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.103568 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:19.129339 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.129307 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:19.129497 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.129431 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:19.129497 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.129480 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:19.129604 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.129560 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:19.288567 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.288479 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="ede64bebdb246dc0cb7eb7abc2d49b2f44608a95063898e5230a1375bcd2bc18" exitCode=0 Jul 09 16:16:19.288567 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.288535 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"ede64bebdb246dc0cb7eb7abc2d49b2f44608a95063898e5230a1375bcd2bc18"} Jul 09 16:16:19.713366 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.713284 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:19.719312 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.719292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:19.719369 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.719340 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:19.719444 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.719431 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:16:19.719484 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.719435 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:16:19.719516 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.719488 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret podName:149f66fa-fa61-4a94-9440-52f6822c33df nodeName:}" failed. No retries permitted until 2026-07-09 16:16:51.719472655 +0000 UTC m=+66.107955043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret") pod "global-pull-secret-syncer-spkts" (UID: "149f66fa-fa61-4a94-9440-52f6822c33df") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:16:19.719516 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.719504 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs podName:59a6b722-697b-48eb-868c-874ce847a050 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:51.71949679 +0000 UTC m=+66.107979156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs") pod "network-metrics-daemon-h84qq" (UID: "59a6b722-697b-48eb-868c-874ce847a050") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:16:19.819923 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.819887 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:19.820061 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.820034 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:16:19.820061 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.820051 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:16:19.820061 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.820060 2571 projected.go:196] Error preparing data for projected volume kube-api-access-mmqqz for pod openshift-network-diagnostics/network-check-target-f7kf9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:16:19.820197 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:19.820108 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz podName:5fdbecce-4230-4a03-b7cd-41974b89d28c nodeName:}" failed. No retries permitted until 2026-07-09 16:16:51.820094509 +0000 UTC m=+66.208576876 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mmqqz" (UniqueName: "kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz") pod "network-check-target-f7kf9" (UID: "5fdbecce-4230-4a03-b7cd-41974b89d28c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:16:19.857427 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.857398 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:19.955201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:19.955154 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:20.130069 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:20.129996 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:20.130226 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:20.130118 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:21.129180 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:21.129144 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:21.129180 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:21.129177 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:21.129952 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:21.129272 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:21.129952 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:21.129406 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:22.129708 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:22.129671 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:22.130128 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:22.129825 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:23.129165 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:23.129126 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:23.129349 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:23.129267 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:23.129349 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:23.129315 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:23.129431 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:23.129405 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:24.129201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:24.129166 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:24.129654 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:24.129279 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:25.129411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:25.129341 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:25.129749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:25.129341 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:25.129749 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:25.129454 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:25.129749 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:25.129505 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:25.305368 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:25.305339 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="bb977a4c74baad3daaf19afd318ca2d70e5f10ea6edcdfaeabef6fd04326dc87" exitCode=0 Jul 09 16:16:25.305521 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:25.305393 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"bb977a4c74baad3daaf19afd318ca2d70e5f10ea6edcdfaeabef6fd04326dc87"} Jul 09 16:16:26.130785 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:26.130738 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:26.131154 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:26.130883 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:26.311069 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:26.311037 2571 generic.go:356] "Generic (PLEG): container finished" podID="247a313f-7192-4269-881f-e1fd23dc2190" containerID="def8c102ec79ea83bd6d1a655e8d0010dff16e5ae7d613765bd147ea5d0c78d3" exitCode=0 Jul 09 16:16:26.311224 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:26.311099 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerDied","Data":"def8c102ec79ea83bd6d1a655e8d0010dff16e5ae7d613765bd147ea5d0c78d3"} Jul 09 16:16:26.436551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:26.436519 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:26.537107 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:26.537065 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.038949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.038917 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.129276 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.129234 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:27.129276 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.129275 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:27.129517 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:27.129366 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:27.129572 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:27.129507 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:27.199078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.199028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.316956 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.316871 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" event={"ID":"247a313f-7192-4269-881f-e1fd23dc2190","Type":"ContainerStarted","Data":"9a734322a76d05237df04692cd3e6b63bc69cc2ef505d942fddffa5fa8b9bda9"} Jul 09 16:16:27.346663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.346608 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5wpt5" podStartSLOduration=12.935975026 podStartE2EDuration="41.34659411s" totalImagesPullingTime="28.410619084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:27.345144209 +0000 UTC m=+41.733626597" watchObservedRunningTime="2026-07-09 16:16:27.34659411 +0000 UTC m=+41.735076499" Jul 09 16:16:27.352029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.352005 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.444725 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.444693 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.590684 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.590600 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.694622 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.694592 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:27.765997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:27.765962 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:28.015938 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.015889 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:28.094169 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.094137 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:28.129203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.129175 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:28.129355 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:28.129290 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:28.404485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.404447 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:28.469264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.469231 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:28.533788 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.533744 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-spkts"] Jul 09 16:16:28.533934 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.533898 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:28.534044 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:28.534021 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:28.536475 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.536451 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7kf9"] Jul 09 16:16:28.536623 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.536544 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:28.536691 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:28.536638 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:28.537330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.537305 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h84qq"] Jul 09 16:16:28.537435 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:28.537403 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:28.537531 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:28.537506 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:30.129320 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:30.129281 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:30.129759 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:30.129282 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:30.129759 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:30.129393 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:30.129759 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:30.129297 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:30.129759 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:30.129467 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:30.129759 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:30.129574 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:32.130056 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.129894 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:32.130449 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.129894 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:32.130449 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:32.130126 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-spkts" podUID="149f66fa-fa61-4a94-9440-52f6822c33df" Jul 09 16:16:32.130449 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.129918 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:32.130449 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:32.130240 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7kf9" podUID="5fdbecce-4230-4a03-b7cd-41974b89d28c" Jul 09 16:16:32.130449 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:32.130278 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h84qq" podUID="59a6b722-697b-48eb-868c-874ce847a050" Jul 09 16:16:32.431017 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.430995 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeReady" Jul 09 16:16:32.431191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.431107 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 16:16:32.479221 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.479187 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-b5cf8"] Jul 09 16:16:32.511849 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.511817 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4wkfn"] Jul 09 16:16:32.512028 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.511970 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.515800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.515751 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6z7vc\"" Jul 09 16:16:32.515930 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.515890 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 16:16:32.516524 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.516504 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 16:16:32.516803 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.516506 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 16:16:32.528026 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.528001 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b5cf8"] Jul 09 16:16:32.528140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.528034 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bdg7f"] Jul 09 16:16:32.528140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.528111 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.531475 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.531451 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 16:16:32.531475 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.531473 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 16:16:32.531626 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.531452 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 16:16:32.532038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.532002 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 16:16:32.532038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.532005 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4w6wt\"" Jul 09 16:16:32.541815 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.541792 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wkfn"] Jul 09 16:16:32.541947 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.541831 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdg7f"] Jul 09 16:16:32.541947 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.541865 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.544717 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.544700 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 16:16:32.544717 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.544711 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6w5fn\"" Jul 09 16:16:32.544875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.544754 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 16:16:32.611832 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.611791 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tntz\" (UniqueName: \"kubernetes.io/projected/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-kube-api-access-7tntz\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.611999 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.611905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-cert\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.650830 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.650799 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:32.712422 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712345 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-tmp-dir\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.712422 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712385 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/812e0308-9d43-4026-9331-7c62aa45f6e2-data-volume\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.712422 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712422 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-config-volume\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712457 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/812e0308-9d43-4026-9331-7c62aa45f6e2-crio-socket\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712516 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-cert\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712534 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-metrics-tls\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712549 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5v2\" (UniqueName: \"kubernetes.io/projected/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-api-access-cb5v2\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.712608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712571 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j8w4\" (UniqueName: \"kubernetes.io/projected/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-kube-api-access-5j8w4\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.712867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712676 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/812e0308-9d43-4026-9331-7c62aa45f6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.712867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.712747 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tntz\" (UniqueName: \"kubernetes.io/projected/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-kube-api-access-7tntz\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.717071 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.717047 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-cert\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.722082 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.722056 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tntz\" (UniqueName: \"kubernetes.io/projected/19a5b4c5-c769-40f8-a762-c9cb3aeb847d-kube-api-access-7tntz\") pod \"ingress-canary-b5cf8\" (UID: \"19a5b4c5-c769-40f8-a762-c9cb3aeb847d\") " pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.739975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.739937 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:32.814025 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.813988 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/812e0308-9d43-4026-9331-7c62aa45f6e2-data-volume\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-config-volume\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.814199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814170 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/812e0308-9d43-4026-9331-7c62aa45f6e2-crio-socket\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814279 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814209 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814279 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814270 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-metrics-tls\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.814360 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814294 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5v2\" (UniqueName: \"kubernetes.io/projected/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-api-access-cb5v2\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814360 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814320 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j8w4\" (UniqueName: \"kubernetes.io/projected/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-kube-api-access-5j8w4\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.814457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814366 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/812e0308-9d43-4026-9331-7c62aa45f6e2-crio-socket\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814385 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/812e0308-9d43-4026-9331-7c62aa45f6e2-data-volume\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814437 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/812e0308-9d43-4026-9331-7c62aa45f6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814754 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814726 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-config-volume\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.814754 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814746 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.814904 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.814820 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-tmp-dir\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.815046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.815031 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-tmp-dir\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.816727 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.816707 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/812e0308-9d43-4026-9331-7c62aa45f6e2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.816862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.816757 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-metrics-tls\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.823262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.823239 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j8w4\" (UniqueName: \"kubernetes.io/projected/4bfdcb55-5c88-46b4-bd5e-608a761a83f3-kube-api-access-5j8w4\") pod \"dns-default-bdg7f\" (UID: \"4bfdcb55-5c88-46b4-bd5e-608a761a83f3\") " pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:32.823509 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.823489 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5v2\" (UniqueName: \"kubernetes.io/projected/812e0308-9d43-4026-9331-7c62aa45f6e2-kube-api-access-cb5v2\") pod \"insights-runtime-extractor-4wkfn\" (UID: \"812e0308-9d43-4026-9331-7c62aa45f6e2\") " pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.824348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.824330 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-b5cf8" Jul 09 16:16:32.836659 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.836638 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4wkfn" Jul 09 16:16:32.849821 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:32.849804 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:33.063860 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.063823 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-b5cf8"] Jul 09 16:16:33.067866 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:33.067835 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5b4c5_c769_40f8_a762_c9cb3aeb847d.slice/crio-9ab9c6dedda08e029a9e2af4ff4e3c9ec3469981af4b40657ec429ff56744d95 WatchSource:0}: Error finding container 9ab9c6dedda08e029a9e2af4ff4e3c9ec3469981af4b40657ec429ff56744d95: Status 404 returned error can't find the container with id 9ab9c6dedda08e029a9e2af4ff4e3c9ec3469981af4b40657ec429ff56744d95 Jul 09 16:16:33.072579 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.072536 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4wkfn"] Jul 09 16:16:33.076359 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:33.076336 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod812e0308_9d43_4026_9331_7c62aa45f6e2.slice/crio-8abf8bac57cf36fb7e9858b625d881624c07e3adc19a5d9a2ee347e28b37b14d WatchSource:0}: Error finding container 8abf8bac57cf36fb7e9858b625d881624c07e3adc19a5d9a2ee347e28b37b14d: Status 404 returned error can't find the container with id 8abf8bac57cf36fb7e9858b625d881624c07e3adc19a5d9a2ee347e28b37b14d Jul 09 16:16:33.082418 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.082395 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bdg7f"] Jul 09 16:16:33.085431 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:33.085410 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfdcb55_5c88_46b4_bd5e_608a761a83f3.slice/crio-5266fe12bda46ec70819bb6ca64601b297f34179b2555e38eb55b829b7a42e3d WatchSource:0}: Error finding container 5266fe12bda46ec70819bb6ca64601b297f34179b2555e38eb55b829b7a42e3d: Status 404 returned error can't find the container with id 5266fe12bda46ec70819bb6ca64601b297f34179b2555e38eb55b829b7a42e3d Jul 09 16:16:33.331503 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.331415 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdg7f" event={"ID":"4bfdcb55-5c88-46b4-bd5e-608a761a83f3","Type":"ContainerStarted","Data":"5266fe12bda46ec70819bb6ca64601b297f34179b2555e38eb55b829b7a42e3d"} Jul 09 16:16:33.332482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.332459 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wkfn" event={"ID":"812e0308-9d43-4026-9331-7c62aa45f6e2","Type":"ContainerStarted","Data":"8abf8bac57cf36fb7e9858b625d881624c07e3adc19a5d9a2ee347e28b37b14d"} Jul 09 16:16:33.333454 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:33.333437 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b5cf8" event={"ID":"19a5b4c5-c769-40f8-a762-c9cb3aeb847d","Type":"ContainerStarted","Data":"9ab9c6dedda08e029a9e2af4ff4e3c9ec3469981af4b40657ec429ff56744d95"} Jul 09 16:16:34.129992 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.129922 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:34.129992 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.129947 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:34.129992 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.129964 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:34.134043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.134012 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:16:34.134275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.134257 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:16:34.134435 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.134421 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c54pk\"" Jul 09 16:16:34.134599 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.134585 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:16:34.134741 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.134726 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:16:34.135787 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.135748 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k799q\"" Jul 09 16:16:34.287423 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.287379 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:34.387555 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:34.387482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:37.245689 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:37.245610 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:37.782292 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:37.782261 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:37.854999 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:37.854967 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:37.965155 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:37.965105 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:38.033077 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:38.032971 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:39.350284 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:39.350249 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdg7f" event={"ID":"4bfdcb55-5c88-46b4-bd5e-608a761a83f3","Type":"ContainerStarted","Data":"d2a690f3b7a337d0675d38f4c262449a1de4f946284b3cfd8eca7e723c5b6e91"} Jul 09 16:16:39.352604 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:39.352569 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wkfn" event={"ID":"812e0308-9d43-4026-9331-7c62aa45f6e2","Type":"ContainerStarted","Data":"cfc9d51c21471ea52209f1a4c644c10e14d53ea67fc376a060bf6b886b0fd190"} Jul 09 16:16:39.354436 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:39.354409 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-b5cf8" event={"ID":"19a5b4c5-c769-40f8-a762-c9cb3aeb847d","Type":"ContainerStarted","Data":"646a8eb4178a02c96edd51607017312d299e8c6cdb845efd49f89a05cdbf1a4f"} Jul 09 16:16:39.372619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:39.372573 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-b5cf8" podStartSLOduration=1.23419466 podStartE2EDuration="7.372558647s" totalImagesPullingTime="6.138363987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:39.371214331 +0000 UTC m=+53.759696724" watchObservedRunningTime="2026-07-09 16:16:39.372558647 +0000 UTC m=+53.761041035" Jul 09 16:16:40.363522 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.363441 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bdg7f" event={"ID":"4bfdcb55-5c88-46b4-bd5e-608a761a83f3","Type":"ContainerStarted","Data":"f75126fe92c2d6812d4608009c0a1c256e7594c5bcc58b33be4022d75fe813d4"} Jul 09 16:16:40.363965 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.363578 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:40.365243 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.365222 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wkfn" event={"ID":"812e0308-9d43-4026-9331-7c62aa45f6e2","Type":"ContainerStarted","Data":"4d7e392eb5fe66dbe131d258a947893e49d114bb980e763beb3161a41a294086"} Jul 09 16:16:40.383038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.382995 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bdg7f" podStartSLOduration=3.335719701 podStartE2EDuration="8.382982302s" totalImagesPullingTime="5.047262601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:40.382443189 +0000 UTC m=+54.770925578" watchObservedRunningTime="2026-07-09 16:16:40.382982302 +0000 UTC m=+54.771464668" Jul 09 16:16:40.633184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.633096 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:40.676720 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.676684 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vh7hv"] Jul 09 16:16:40.678972 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.678953 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.681608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.681582 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 16:16:40.681719 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.681589 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h7vfn\"" Jul 09 16:16:40.682618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.682597 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 16:16:40.682711 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.682654 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 16:16:40.682800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.682752 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 16:16:40.682800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.682761 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 16:16:40.687874 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.687854 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vh7hv"] Jul 09 16:16:40.707802 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.707756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:40.770516 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.770483 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:40.778528 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.778498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1f5bfc-abff-4261-9cdf-bb522cc33316-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.778680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.778551 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.778680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.778585 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.778680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.778640 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjjn\" (UniqueName: \"kubernetes.io/projected/eb1f5bfc-abff-4261-9cdf-bb522cc33316-kube-api-access-bnjjn\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.879154 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.879117 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1f5bfc-abff-4261-9cdf-bb522cc33316-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.879337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.879175 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.879337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.879203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.879909 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.879510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjjn\" (UniqueName: \"kubernetes.io/projected/eb1f5bfc-abff-4261-9cdf-bb522cc33316-kube-api-access-bnjjn\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.879909 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.879867 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb1f5bfc-abff-4261-9cdf-bb522cc33316-metrics-client-ca\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.882680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.882650 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.882846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.882824 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb1f5bfc-abff-4261-9cdf-bb522cc33316-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.888428 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.888363 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjjn\" (UniqueName: \"kubernetes.io/projected/eb1f5bfc-abff-4261-9cdf-bb522cc33316-kube-api-access-bnjjn\") pod \"prometheus-operator-64785b6675-vh7hv\" (UID: \"eb1f5bfc-abff-4261-9cdf-bb522cc33316\") " pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:40.990640 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:40.990602 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" Jul 09 16:16:41.128092 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:41.128059 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-vh7hv"] Jul 09 16:16:41.131724 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:41.131695 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1f5bfc_abff_4261_9cdf_bb522cc33316.slice/crio-c8cd44ca1deb7b3bbed6f614615180888d92793bf11f432d520b889ce9b124e4 WatchSource:0}: Error finding container c8cd44ca1deb7b3bbed6f614615180888d92793bf11f432d520b889ce9b124e4: Status 404 returned error can't find the container with id c8cd44ca1deb7b3bbed6f614615180888d92793bf11f432d520b889ce9b124e4 Jul 09 16:16:41.370793 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:41.370737 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" event={"ID":"eb1f5bfc-abff-4261-9cdf-bb522cc33316","Type":"ContainerStarted","Data":"c8cd44ca1deb7b3bbed6f614615180888d92793bf11f432d520b889ce9b124e4"} Jul 09 16:16:43.379733 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:43.379692 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4wkfn" event={"ID":"812e0308-9d43-4026-9331-7c62aa45f6e2","Type":"ContainerStarted","Data":"e60466819d70a77f50a4cd975deec178c21168fd9afbdb0cb6e678015f7331a9"} Jul 09 16:16:43.399671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:43.399620 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4wkfn" podStartSLOduration=2.122465546 podStartE2EDuration="11.399601836s" totalImagesPullingTime="9.27713629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:16:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:43.397749347 +0000 UTC m=+57.786231740" watchObservedRunningTime="2026-07-09 16:16:43.399601836 +0000 UTC m=+57.788084225" Jul 09 16:16:43.754283 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:43.754242 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:44.384265 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:44.384221 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" event={"ID":"eb1f5bfc-abff-4261-9cdf-bb522cc33316","Type":"ContainerStarted","Data":"12a71a4b24b8eda699c62f34688f71abe5eec9071c46db1e517f430af1ea2099"} Jul 09 16:16:44.384630 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:44.384286 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" event={"ID":"eb1f5bfc-abff-4261-9cdf-bb522cc33316","Type":"ContainerStarted","Data":"e5bd7e9b3cc557cb0ec74db3194b56c693318d33f8b71b716444905b623a81c5"} Jul 09 16:16:44.402334 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:44.402289 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-vh7hv" podStartSLOduration=2.075039577 podStartE2EDuration="4.402273469s" totalImagesPullingTime="2.327233892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:44.400548034 +0000 UTC m=+58.789030424" watchObservedRunningTime="2026-07-09 16:16:44.402273469 +0000 UTC m=+58.790755884" Jul 09 16:16:45.772017 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:45.771971 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:45.920983 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:45.920945 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:46.023633 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.023555 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:46.061362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.061325 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5n6xf"] Jul 09 16:16:46.091954 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.091914 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.094738 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.094710 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 16:16:46.095232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.095126 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zhzht\"" Jul 09 16:16:46.095345 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.095311 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 16:16:46.095448 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.095426 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 16:16:46.118964 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.118932 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-textfile\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.118964 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.118965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.118985 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-metrics-client-ca\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119007 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119049 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-root\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119084 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-sys\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-wtmp\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119123 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.119203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.119166 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjh5t\" (UniqueName: \"kubernetes.io/projected/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-kube-api-access-pjh5t\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.122974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.122947 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:46.219826 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219765 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-textfile\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219838 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219854 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-metrics-client-ca\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219874 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219896 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-root\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-sys\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.219929 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-wtmp\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:46.220015 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220041 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220048 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-root\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220047 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-wtmp\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220011 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-sys\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:46.220119 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls podName:66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:46.720095388 +0000 UTC m=+61.108577768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls") pod "node-exporter-5n6xf" (UID: "66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3") : secret "node-exporter-tls" not found Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220118 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-textfile\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220170 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjh5t\" (UniqueName: \"kubernetes.io/projected/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-kube-api-access-pjh5t\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220416 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-metrics-client-ca\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.220549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.220493 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-accelerators-collector-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.222222 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.222206 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.231155 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.231128 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjh5t\" (UniqueName: \"kubernetes.io/projected/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-kube-api-access-pjh5t\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.587173 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.587144 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:46.688139 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.688105 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:46.723579 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.723537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.725967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.725943 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3-node-exporter-tls\") pod \"node-exporter-5n6xf\" (UID: \"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3\") " pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:46.955249 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:46.955202 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.002540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.002508 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5n6xf" Jul 09 16:16:47.012392 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:47.012355 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66fbb18e_ec53_42b5_8cfd_aa5ec4669aa3.slice/crio-ea9e19c09e5e5dcef3bb53c43f15d3c2a4b6c9de2c8949e44c5ff7053cec11d5 WatchSource:0}: Error finding container ea9e19c09e5e5dcef3bb53c43f15d3c2a4b6c9de2c8949e44c5ff7053cec11d5: Status 404 returned error can't find the container with id ea9e19c09e5e5dcef3bb53c43f15d3c2a4b6c9de2c8949e44c5ff7053cec11d5 Jul 09 16:16:47.052269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.052223 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.112827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.112794 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:16:47.115606 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.115588 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.118110 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118079 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 16:16:47.118240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118135 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 16:16:47.118240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118077 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 16:16:47.118240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118165 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 16:16:47.118496 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118466 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 16:16:47.118613 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118599 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rhqxp\"" Jul 09 16:16:47.118668 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118602 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 16:16:47.118764 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118722 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 16:16:47.118932 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118913 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 16:16:47.119012 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.118917 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 16:16:47.127614 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127592 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127724 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127622 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127724 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127724 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127658 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127857 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127735 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zwf\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127857 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127797 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127857 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127842 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127871 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127904 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127919 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.127967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.128108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.128108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.127995 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.144933 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.144901 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:16:47.153460 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.153422 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.229323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229227 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229268 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229417 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zwf\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229457 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229491 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229602 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229651 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229674 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.229870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.229760 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.230267 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:47.229914 2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 16:16:47.230267 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:47.229984 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls podName:1c702841-5c70-455c-aaf9-697c56006fc5 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:47.72996538 +0000 UTC m=+62.118447761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5") : secret "alertmanager-main-tls" not found Jul 09 16:16:47.230267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.230032 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.230267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.230145 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.230267 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:47.230245 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle podName:1c702841-5c70-455c-aaf9-697c56006fc5 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:47.730227441 +0000 UTC m=+62.118709823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5") : configmap references non-existent config key: ca-bundle.crt Jul 09 16:16:47.232444 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.232410 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.232633 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.232609 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233204 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.232932 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233204 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.233163 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.233345 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.233448 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233622 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.233603 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.233680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.233648 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.237963 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.237945 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zwf\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.268929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.268893 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.290193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.290167 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qg8db" Jul 09 16:16:47.376918 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.376881 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.393445 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.393410 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5n6xf" event={"ID":"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3","Type":"ContainerStarted","Data":"ea9e19c09e5e5dcef3bb53c43f15d3c2a4b6c9de2c8949e44c5ff7053cec11d5"} Jul 09 16:16:47.470586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.470553 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.570380 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.570297 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:47.734044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.734003 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.734044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.734050 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.734319 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:47.734170 2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 16:16:47.734319 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:16:47.734238 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls podName:1c702841-5c70-455c-aaf9-697c56006fc5 nodeName:}" failed. No retries permitted until 2026-07-09 16:16:48.734222538 +0000 UTC m=+63.122704908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5") : secret "alertmanager-main-tls" not found Jul 09 16:16:47.734945 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.734916 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:47.802513 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:47.802481 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:48.003013 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.002977 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76f9f98f6b-96wwj"] Jul 09 16:16:48.006286 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.006263 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.008975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.008951 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 16:16:48.009221 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009199 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 16:16:48.009326 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009244 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-58nkg\"" Jul 09 16:16:48.009326 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009199 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 16:16:48.009326 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009198 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 16:16:48.009991 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009973 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 16:16:48.010065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.009973 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-196588bc3m2do\"" Jul 09 16:16:48.018144 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.018124 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76f9f98f6b-96wwj"] Jul 09 16:16:48.036602 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036575 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036753 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036619 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srpwd\" (UniqueName: \"kubernetes.io/projected/cecbdea0-e524-49f3-b5f8-79053b25389a-kube-api-access-srpwd\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036753 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036648 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036753 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036796 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecbdea0-e524-49f3-b5f8-79053b25389a-metrics-client-ca\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036821 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-grpc-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.036973 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.036905 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.137735 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.137699 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecbdea0-e524-49f3-b5f8-79053b25389a-metrics-client-ca\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.137735 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.137737 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-grpc-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138016 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.137759 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138016 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.137973 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138131 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.138051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138131 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.138099 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srpwd\" (UniqueName: \"kubernetes.io/projected/cecbdea0-e524-49f3-b5f8-79053b25389a-kube-api-access-srpwd\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.138157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.138188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.138476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.138440 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cecbdea0-e524-49f3-b5f8-79053b25389a-metrics-client-ca\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.141158 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.141114 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.141254 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.141199 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.141298 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.141249 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-grpc-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.141631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.141611 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.141631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.141624 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.142031 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.142003 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/cecbdea0-e524-49f3-b5f8-79053b25389a-secret-thanos-querier-tls\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.146390 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.146372 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srpwd\" (UniqueName: \"kubernetes.io/projected/cecbdea0-e524-49f3-b5f8-79053b25389a-kube-api-access-srpwd\") pod \"thanos-querier-76f9f98f6b-96wwj\" (UID: \"cecbdea0-e524-49f3-b5f8-79053b25389a\") " pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.315164 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.315068 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:48.468136 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.468101 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76f9f98f6b-96wwj"] Jul 09 16:16:48.565694 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:48.565620 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecbdea0_e524_49f3_b5f8_79053b25389a.slice/crio-345f5b072557949c867ef5a89bf661ed0d46d79b69db1eb31589ae7534d92bf2 WatchSource:0}: Error finding container 345f5b072557949c867ef5a89bf661ed0d46d79b69db1eb31589ae7534d92bf2: Status 404 returned error can't find the container with id 345f5b072557949c867ef5a89bf661ed0d46d79b69db1eb31589ae7534d92bf2 Jul 09 16:16:48.743529 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.743499 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:48.745916 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.745897 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:48.925120 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.925084 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:16:48.967419 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:48.967384 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:49.065679 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.065640 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:49.066503 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.066481 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:16:49.069214 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:49.069194 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c702841_5c70_455c_aaf9_697c56006fc5.slice/crio-18483b7b0c8572941036bb03175a4b09e9a1f9950174dbdfc2838be6384348a7 WatchSource:0}: Error finding container 18483b7b0c8572941036bb03175a4b09e9a1f9950174dbdfc2838be6384348a7: Status 404 returned error can't find the container with id 18483b7b0c8572941036bb03175a4b09e9a1f9950174dbdfc2838be6384348a7 Jul 09 16:16:49.263443 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.263341 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:49.403533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.403492 2571 generic.go:356] "Generic (PLEG): container finished" podID="66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3" containerID="f2f8233bd739d953a8c7a519b72cf2ad0700e94d6f29d1f37dc582c7dffc32de" exitCode=0 Jul 09 16:16:49.403693 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.403595 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5n6xf" event={"ID":"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3","Type":"ContainerDied","Data":"f2f8233bd739d953a8c7a519b72cf2ad0700e94d6f29d1f37dc582c7dffc32de"} Jul 09 16:16:49.404949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.404920 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"18483b7b0c8572941036bb03175a4b09e9a1f9950174dbdfc2838be6384348a7"} Jul 09 16:16:49.406421 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.406399 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"345f5b072557949c867ef5a89bf661ed0d46d79b69db1eb31589ae7534d92bf2"} Jul 09 16:16:49.430906 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.430885 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:49.695586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.695547 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:49.751544 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:49.751504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:50.373391 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.373353 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bdg7f" Jul 09 16:16:50.413882 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.413753 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5n6xf" event={"ID":"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3","Type":"ContainerStarted","Data":"bf0b15599463ee98f03652d33af53569ecd61c95512650b911dd433f4bcd419e"} Jul 09 16:16:50.413882 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.413845 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5n6xf" event={"ID":"66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3","Type":"ContainerStarted","Data":"fda279a8d0b3473348598264f2c0ca0a1912b3ff882041a40fcc4df69c1a7aaf"} Jul 09 16:16:50.415989 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.415959 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197"} Jul 09 16:16:50.452106 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.452003 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5n6xf" podStartSLOduration=2.804138688 podStartE2EDuration="4.451981656s" totalImagesPullingTime="1.576882634s" totalInitContainerRuntime="70.960334ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:50.450365444 +0000 UTC m=+64.838847843" watchObservedRunningTime="2026-07-09 16:16:50.451981656 +0000 UTC m=+64.840464045" Jul 09 16:16:50.511923 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.511885 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55dd8c54b-h694h"] Jul 09 16:16:50.514287 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.514263 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.521159 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.521135 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 16:16:50.521523 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.521497 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 16:16:50.521874 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.521796 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c6t0o80ns9k87\"" Jul 09 16:16:50.522489 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.522466 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4wt7q\"" Jul 09 16:16:50.522601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.522517 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 16:16:50.522601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.522580 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 16:16:50.547474 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.547441 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55dd8c54b-h694h"] Jul 09 16:16:50.559956 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.559924 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-client-certs\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560128 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.559976 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9c8\" (UniqueName: \"kubernetes.io/projected/3baac756-b1f3-4241-9b9c-ba46b78f9214-kube-api-access-rh9c8\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560128 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.560043 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-tls\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560128 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.560077 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.560149 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-metrics-server-audit-profiles\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.560182 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3baac756-b1f3-4241-9b9c-ba46b78f9214-audit-log\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.560260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.560199 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-client-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.575615 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.575575 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:50.661626 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661586 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-metrics-server-audit-profiles\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.661850 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661652 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3baac756-b1f3-4241-9b9c-ba46b78f9214-audit-log\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.661850 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661677 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-client-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.661850 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661739 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-client-certs\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.661850 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661797 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9c8\" (UniqueName: \"kubernetes.io/projected/3baac756-b1f3-4241-9b9c-ba46b78f9214-kube-api-access-rh9c8\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.661850 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661829 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-tls\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.662115 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.661851 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.662403 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.662380 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3baac756-b1f3-4241-9b9c-ba46b78f9214-audit-log\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.662548 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.662519 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.662784 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.662745 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3baac756-b1f3-4241-9b9c-ba46b78f9214-metrics-server-audit-profiles\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.665147 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.665122 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-client-certs\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.665235 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.665198 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-client-ca-bundle\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.665586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.665565 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3baac756-b1f3-4241-9b9c-ba46b78f9214-secret-metrics-server-tls\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.679032 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.679009 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9c8\" (UniqueName: \"kubernetes.io/projected/3baac756-b1f3-4241-9b9c-ba46b78f9214-kube-api-access-rh9c8\") pod \"metrics-server-55dd8c54b-h694h\" (UID: \"3baac756-b1f3-4241-9b9c-ba46b78f9214\") " pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.703756 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.703671 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:50.825595 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.825565 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:16:50.837443 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.837405 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:50.969614 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:50.969594 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55dd8c54b-h694h"] Jul 09 16:16:50.971755 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:50.971730 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3baac756_b1f3_4241_9b9c_ba46b78f9214.slice/crio-9bf9bb8294d9efa6eb3e45619c148c031262801d12b438c2e12a4f60c902cd51 WatchSource:0}: Error finding container 9bf9bb8294d9efa6eb3e45619c148c031262801d12b438c2e12a4f60c902cd51: Status 404 returned error can't find the container with id 9bf9bb8294d9efa6eb3e45619c148c031262801d12b438c2e12a4f60c902cd51 Jul 09 16:16:51.319835 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.319727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:51.420031 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.419993 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197" exitCode=0 Jul 09 16:16:51.420477 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.420069 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197"} Jul 09 16:16:51.422324 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.422294 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"090ffa226698c3dfd9a2ff652353c3ec2d485ec246e79a984e810c4c4c07b13a"} Jul 09 16:16:51.422433 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.422354 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"b500637fe9c77494693416a7d06d834c672d211a5822d1e61aefc14a44f8fd3e"} Jul 09 16:16:51.422433 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.422395 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"e0094a13e1660efc86e1293158a511cee9c0cd9d18b8e934e1e7309150b19796"} Jul 09 16:16:51.423370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.423348 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" event={"ID":"3baac756-b1f3-4241-9b9c-ba46b78f9214","Type":"ContainerStarted","Data":"9bf9bb8294d9efa6eb3e45619c148c031262801d12b438c2e12a4f60c902cd51"} Jul 09 16:16:51.773270 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.773229 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:51.773476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.773312 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:51.775994 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.775956 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:16:51.776107 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.776049 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:16:51.786926 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.786897 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/149f66fa-fa61-4a94-9440-52f6822c33df-original-pull-secret\") pod \"global-pull-secret-syncer-spkts\" (UID: \"149f66fa-fa61-4a94-9440-52f6822c33df\") " pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:51.787020 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.786947 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59a6b722-697b-48eb-868c-874ce847a050-metrics-certs\") pod \"network-metrics-daemon-h84qq\" (UID: \"59a6b722-697b-48eb-868c-874ce847a050\") " pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:51.858170 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.858142 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k799q\"" Jul 09 16:16:51.863008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.862987 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-spkts" Jul 09 16:16:51.865910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.865890 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h84qq" Jul 09 16:16:51.874798 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.874682 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:51.877178 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.877159 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:16:51.888188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.888162 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:16:51.899732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:51.899514 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqqz\" (UniqueName: \"kubernetes.io/projected/5fdbecce-4230-4a03-b7cd-41974b89d28c-kube-api-access-mmqqz\") pod \"network-check-target-f7kf9\" (UID: \"5fdbecce-4230-4a03-b7cd-41974b89d28c\") " pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:52.023459 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.023301 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-spkts"] Jul 09 16:16:52.048111 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.048028 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h84qq"] Jul 09 16:16:52.097293 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:52.097259 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod149f66fa_fa61_4a94_9440_52f6822c33df.slice/crio-be8becafb55d6ff7f94a760e9731ba1c7c4be4cc1c5c8a2f19e51c21f9b8a218 WatchSource:0}: Error finding container be8becafb55d6ff7f94a760e9731ba1c7c4be4cc1c5c8a2f19e51c21f9b8a218: Status 404 returned error can't find the container with id be8becafb55d6ff7f94a760e9731ba1c7c4be4cc1c5c8a2f19e51c21f9b8a218 Jul 09 16:16:52.149385 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.149183 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c54pk\"" Jul 09 16:16:52.157530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.157505 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:52.271327 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.271292 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:52.428935 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.428892 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-spkts" event={"ID":"149f66fa-fa61-4a94-9440-52f6822c33df","Type":"ContainerStarted","Data":"be8becafb55d6ff7f94a760e9731ba1c7c4be4cc1c5c8a2f19e51c21f9b8a218"} Jul 09 16:16:52.542436 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:52.542397 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a6b722_697b_48eb_868c_874ce847a050.slice/crio-2a1da4c45a62ca6306fafd0564858d1b843b73c3d9b6d27ce3d48fef9ba3bdbc WatchSource:0}: Error finding container 2a1da4c45a62ca6306fafd0564858d1b843b73c3d9b6d27ce3d48fef9ba3bdbc: Status 404 returned error can't find the container with id 2a1da4c45a62ca6306fafd0564858d1b843b73c3d9b6d27ce3d48fef9ba3bdbc Jul 09 16:16:52.745862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:52.745838 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7kf9"] Jul 09 16:16:52.750051 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:52.750025 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdbecce_4230_4a03_b7cd_41974b89d28c.slice/crio-d9af4c8032b2fe896cd0a0acf7e88d24992cc1e300f065d5623cd45df86b9091 WatchSource:0}: Error finding container d9af4c8032b2fe896cd0a0acf7e88d24992cc1e300f065d5623cd45df86b9091: Status 404 returned error can't find the container with id d9af4c8032b2fe896cd0a0acf7e88d24992cc1e300f065d5623cd45df86b9091 Jul 09 16:16:53.439184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.438072 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"983a068b80074cc02f196c019dbd35b06459b2c013058ad953f5a53ed70dc15d"} Jul 09 16:16:53.439184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.438155 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"50b63a4e236f4f309cacca3b9d05a1fd5c6dd3cb6feb414b97cff2d289c88f5b"} Jul 09 16:16:53.439184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.438286 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:53.439184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.438338 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" event={"ID":"cecbdea0-e524-49f3-b5f8-79053b25389a","Type":"ContainerStarted","Data":"38325485544f620840348831b7004a9adf60e38772f20d8b85437343ac88e4d8"} Jul 09 16:16:53.439763 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.439739 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h84qq" event={"ID":"59a6b722-697b-48eb-868c-874ce847a050","Type":"ContainerStarted","Data":"2a1da4c45a62ca6306fafd0564858d1b843b73c3d9b6d27ce3d48fef9ba3bdbc"} Jul 09 16:16:53.441517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.441491 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" event={"ID":"3baac756-b1f3-4241-9b9c-ba46b78f9214","Type":"ContainerStarted","Data":"430715c3b717fa9511e22cb26d7e25ef5606e21a134cdb139fa12d4f6440fd1a"} Jul 09 16:16:53.443595 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.443571 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7kf9" event={"ID":"5fdbecce-4230-4a03-b7cd-41974b89d28c","Type":"ContainerStarted","Data":"d9af4c8032b2fe896cd0a0acf7e88d24992cc1e300f065d5623cd45df86b9091"} Jul 09 16:16:53.463851 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.463109 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" podStartSLOduration=2.63310329 podStartE2EDuration="6.463086261s" totalImagesPullingTime="3.829982971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:53.460789983 +0000 UTC m=+67.849272372" watchObservedRunningTime="2026-07-09 16:16:53.463086261 +0000 UTC m=+67.851568647" Jul 09 16:16:53.810761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.810598 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" podStartSLOduration=2.189580108 podStartE2EDuration="3.810572297s" totalImagesPullingTime="1.620992189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:53.479310413 +0000 UTC m=+67.867792804" watchObservedRunningTime="2026-07-09 16:16:53.810572297 +0000 UTC m=+68.199054689" Jul 09 16:16:53.811066 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.811041 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-85dqc"] Jul 09 16:16:53.816644 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.815919 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:16:53.817908 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.817856 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-85dqc"] Jul 09 16:16:53.819548 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.819519 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jz4bc\"" Jul 09 16:16:53.819649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.819559 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:16:53.819882 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.819853 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:16:53.836795 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.836671 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:53.896352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.896308 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9mpq\" (UniqueName: \"kubernetes.io/projected/d295172d-0b96-4338-a07c-1e19f6951bb6-kube-api-access-z9mpq\") pod \"downloads-68c9cbb497-85dqc\" (UID: \"d295172d-0b96-4338-a07c-1e19f6951bb6\") " pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:16:53.930394 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.930350 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:53.997171 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:53.997109 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9mpq\" (UniqueName: \"kubernetes.io/projected/d295172d-0b96-4338-a07c-1e19f6951bb6-kube-api-access-z9mpq\") pod \"downloads-68c9cbb497-85dqc\" (UID: \"d295172d-0b96-4338-a07c-1e19f6951bb6\") " pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:16:54.007847 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.007812 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9mpq\" (UniqueName: \"kubernetes.io/projected/d295172d-0b96-4338-a07c-1e19f6951bb6-kube-api-access-z9mpq\") pod \"downloads-68c9cbb497-85dqc\" (UID: \"d295172d-0b96-4338-a07c-1e19f6951bb6\") " pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:16:54.137053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.136934 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:16:54.138659 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.138618 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:54.312278 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.312160 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:54.516358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.516324 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:54.521354 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.520513 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-85dqc"] Jul 09 16:16:54.526234 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:16:54.526007 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd295172d_0b96_4338_a07c_1e19f6951bb6.slice/crio-8a27fb70faa3d8bfb0d38d17d8f587e7dfde3fd3b8744d5eb55a603dac5921b9 WatchSource:0}: Error finding container 8a27fb70faa3d8bfb0d38d17d8f587e7dfde3fd3b8744d5eb55a603dac5921b9: Status 404 returned error can't find the container with id 8a27fb70faa3d8bfb0d38d17d8f587e7dfde3fd3b8744d5eb55a603dac5921b9 Jul 09 16:16:54.617168 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.617093 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:54.716137 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:54.716109 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:55.329336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.329300 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:55.463887 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.463848 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f"} Jul 09 16:16:55.464065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.463944 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9"} Jul 09 16:16:55.464065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.463988 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55"} Jul 09 16:16:55.464065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.464030 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503"} Jul 09 16:16:55.464237 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.464069 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52"} Jul 09 16:16:55.464237 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.464105 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerStarted","Data":"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88"} Jul 09 16:16:55.465920 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.465886 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h84qq" event={"ID":"59a6b722-697b-48eb-868c-874ce847a050","Type":"ContainerStarted","Data":"2ab9ff7869b963340baeeeadbc8df6dc52b12162d959cf6f71f1849001fc89db"} Jul 09 16:16:55.466053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.465940 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h84qq" event={"ID":"59a6b722-697b-48eb-868c-874ce847a050","Type":"ContainerStarted","Data":"06bb4f108c5d050827c7a975ff665ac5879c0fdc25fcdbdd8c560ce4cbaf2f2e"} Jul 09 16:16:55.467106 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.467084 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-85dqc" event={"ID":"d295172d-0b96-4338-a07c-1e19f6951bb6","Type":"ContainerStarted","Data":"8a27fb70faa3d8bfb0d38d17d8f587e7dfde3fd3b8744d5eb55a603dac5921b9"} Jul 09 16:16:55.517025 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.516963 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.432745588 podStartE2EDuration="8.516940632s" totalImagesPullingTime="4.067118801s" totalInitContainerRuntime="17.076243ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:55.496739345 +0000 UTC m=+69.885221735" watchObservedRunningTime="2026-07-09 16:16:55.516940632 +0000 UTC m=+69.905423086" Jul 09 16:16:55.518199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.518158 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h84qq" podStartSLOduration=67.736808229 podStartE2EDuration="1m9.518146686s" totalImagesPullingTime="1.781338457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:55.516445429 +0000 UTC m=+69.904927820" watchObservedRunningTime="2026-07-09 16:16:55.518146686 +0000 UTC m=+69.906629098" Jul 09 16:16:55.621088 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.620960 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:55.720810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.720754 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:55.823390 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.823352 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:55.957115 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:55.957081 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:56.530604 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:56.530569 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:56.631568 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:56.631498 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:56.759467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:56.759437 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:56.823252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:56.823147 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:58.126148 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:58.126109 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:58.229620 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:58.229583 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:16:59.463049 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.463017 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76f9f98f6b-96wwj" Jul 09 16:16:59.489820 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.489758 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7kf9" event={"ID":"5fdbecce-4230-4a03-b7cd-41974b89d28c","Type":"ContainerStarted","Data":"04d31f769757566219e48326059211229423fdf30deaa9cb11870a3f4ef41474"} Jul 09 16:16:59.490006 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.489961 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:16:59.491581 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.491533 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-spkts" event={"ID":"149f66fa-fa61-4a94-9440-52f6822c33df","Type":"ContainerStarted","Data":"cb9a4b154b06d1ad57519349e17408fac2cb7c34c9408921187a9ade2d262222"} Jul 09 16:16:59.511083 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.511006 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f7kf9" podStartSLOduration=67.521663215 podStartE2EDuration="1m13.510988144s" totalImagesPullingTime="5.989324929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:59.509700939 +0000 UTC m=+73.898183328" watchObservedRunningTime="2026-07-09 16:16:59.510988144 +0000 UTC m=+73.899470532" Jul 09 16:16:59.525813 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:16:59.525691 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-spkts" podStartSLOduration=66.872091582 podStartE2EDuration="1m13.525666725s" totalImagesPullingTime="6.653575143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:16:59.524464199 +0000 UTC m=+73.912946589" watchObservedRunningTime="2026-07-09 16:16:59.525666725 +0000 UTC m=+73.914149115" Jul 09 16:17:04.320452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.320415 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:04.378961 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.378927 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:04.527456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.527425 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:04.530492 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.530467 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534483 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534522 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534538 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534482 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534482 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jwrd9\"" Jul 09 16:17:04.534953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.534494 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:17:04.540312 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.540288 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:04.593936 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.593848 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.593936 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.593886 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwwt\" (UniqueName: \"kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.594124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.593999 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.594124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.594042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.594124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.594061 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.594124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.594115 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.694827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.694762 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.694827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.694822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.694860 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.694890 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.694956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwwt\" (UniqueName: \"kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.695021 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695895 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.695656 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695895 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.695691 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.695895 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.695719 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.697947 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.697923 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.698196 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.698077 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.698196 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.698164 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:04.703947 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.703920 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwwt\" (UniqueName: \"kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt\") pod \"console-74d599864c-ns6fn\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.759917 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.759880 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:04.840991 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.840948 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:04.974276 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:04.974254 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:04.976937 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:17:04.976914 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c48332_6af8_4618_b7b4_83ab26bd0ccb.slice/crio-58cd763873aebd84ede448a34381dd5c685b1f20aa9ad5c00260e7c5a060d3a9 WatchSource:0}: Error finding container 58cd763873aebd84ede448a34381dd5c685b1f20aa9ad5c00260e7c5a060d3a9: Status 404 returned error can't find the container with id 58cd763873aebd84ede448a34381dd5c685b1f20aa9ad5c00260e7c5a060d3a9 Jul 09 16:17:05.521511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:05.521474 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d599864c-ns6fn" event={"ID":"60c48332-6af8-4618-b7b4-83ab26bd0ccb","Type":"ContainerStarted","Data":"58cd763873aebd84ede448a34381dd5c685b1f20aa9ad5c00260e7c5a060d3a9"} Jul 09 16:17:05.840824 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:05.840672 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:05.903177 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:05.903124 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:07.929988 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:07.929946 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:07.991385 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:07.991358 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:09.539243 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:09.539162 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d599864c-ns6fn" event={"ID":"60c48332-6af8-4618-b7b4-83ab26bd0ccb","Type":"ContainerStarted","Data":"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c"} Jul 09 16:17:09.557144 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:09.557095 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d599864c-ns6fn" podStartSLOduration=1.365750287 podStartE2EDuration="5.55707983s" totalImagesPullingTime="4.191329543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:17:09.55614953 +0000 UTC m=+83.944631919" watchObservedRunningTime="2026-07-09 16:17:09.55707983 +0000 UTC m=+83.945562213" Jul 09 16:17:09.724680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:09.724641 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:09.784091 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:09.784058 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:10.826018 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:10.825985 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:17:10.826375 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:10.826053 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:17:13.315760 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.315724 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:17:13.345499 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.345463 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:17:13.345649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.345590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.354111 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.354082 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:17:13.473869 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.473824 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.473901 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.473949 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.473981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.474067 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msgw9\" (UniqueName: \"kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.474096 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.474188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.474122 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.522988 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.522955 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:13.575148 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575060 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msgw9\" (UniqueName: \"kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575148 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575105 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575148 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575132 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575159 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575207 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575243 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.575414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.575263 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.576214 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.576166 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.576341 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.576262 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.576402 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.576367 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.576511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.576487 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.578172 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.578148 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.578287 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.578190 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.583694 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.583648 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msgw9\" (UniqueName: \"kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9\") pod \"console-6d7897b5fb-555tk\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:13.657645 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:13.657610 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:14.841912 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:14.841868 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:14.842489 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:14.841943 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:14.847657 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:14.847630 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:15.566901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:15.566874 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:18.275846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.275803 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:17:18.277898 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:17:18.277874 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e79be0e_dc63_429f_8c2f_7b53f34225f4.slice/crio-7e2d539420a2cbaa72a0bdf0ed82cb480cc149d420760b3bdbde2a48d2e09211 WatchSource:0}: Error finding container 7e2d539420a2cbaa72a0bdf0ed82cb480cc149d420760b3bdbde2a48d2e09211: Status 404 returned error can't find the container with id 7e2d539420a2cbaa72a0bdf0ed82cb480cc149d420760b3bdbde2a48d2e09211 Jul 09 16:17:18.575963 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.575935 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7897b5fb-555tk" event={"ID":"9e79be0e-dc63-429f-8c2f-7b53f34225f4","Type":"ContainerStarted","Data":"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e"} Jul 09 16:17:18.576094 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.575982 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7897b5fb-555tk" event={"ID":"9e79be0e-dc63-429f-8c2f-7b53f34225f4","Type":"ContainerStarted","Data":"7e2d539420a2cbaa72a0bdf0ed82cb480cc149d420760b3bdbde2a48d2e09211"} Jul 09 16:17:18.594367 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.594319 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7897b5fb-555tk" podStartSLOduration=5.594300894 podStartE2EDuration="5.594300894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:17:18.592749555 +0000 UTC m=+92.981231947" watchObservedRunningTime="2026-07-09 16:17:18.594300894 +0000 UTC m=+92.982783283" Jul 09 16:17:18.919872 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.919833 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:18.981322 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:18.981281 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:19.583063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:19.583026 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-85dqc" event={"ID":"d295172d-0b96-4338-a07c-1e19f6951bb6","Type":"ContainerStarted","Data":"320f751c04449a4741f6362f568770d066975221165f563eb6a1be1079d8b701"} Jul 09 16:17:19.726826 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:19.726796 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:19.840897 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:19.840802 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:20.587709 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:20.587670 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:17:20.605386 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:20.605358 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-85dqc" Jul 09 16:17:20.624759 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:20.624694 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-85dqc" podStartSLOduration=3.628433442 podStartE2EDuration="27.624677287s" totalImagesPullingTime="23.996243845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:17:19.602926391 +0000 UTC m=+93.991408779" watchObservedRunningTime="2026-07-09 16:17:20.624677287 +0000 UTC m=+95.013159676" Jul 09 16:17:23.658238 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:23.658198 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:23.658721 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:23.658273 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:23.663693 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:23.663668 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:24.609566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:24.609532 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:17:24.658455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:24.658422 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:25.943482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:25.943439 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:26.058807 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:26.058735 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:26.129729 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:26.129691 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:26.192485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:26.192448 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:29.289703 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:29.289670 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:29.347812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:29.347761 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:30.500127 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:30.500101 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f7kf9" Jul 09 16:17:30.832215 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:30.832132 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:17:30.836237 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:30.836210 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55dd8c54b-h694h" Jul 09 16:17:34.533032 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:34.533001 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:34.588468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:34.588437 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:34.788660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:34.788574 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:34.847605 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:34.847581 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:17:49.689324 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:49.689255 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74d599864c-ns6fn" podUID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" containerName="console" containerID="cri-o://9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c" gracePeriod=15 Jul 09 16:17:49.980263 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:49.980226 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:50.083440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083403 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083453 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083508 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083589 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083638 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzwwt\" (UniqueName: \"kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083878 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083661 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config\") pod \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\" (UID: \"60c48332-6af8-4618-b7b4-83ab26bd0ccb\") " Jul 09 16:17:50.083951 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083925 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca" (OuterVolumeSpecName: "service-ca") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:17:50.084012 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.083986 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:17:50.084069 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.084051 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config" (OuterVolumeSpecName: "console-config") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:17:50.085936 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.085908 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:17:50.086039 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.085928 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt" (OuterVolumeSpecName: "kube-api-access-tzwwt") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "kube-api-access-tzwwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:17:50.086039 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.085953 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "60c48332-6af8-4618-b7b4-83ab26bd0ccb" (UID: "60c48332-6af8-4618-b7b4-83ab26bd0ccb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:17:50.184710 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184685 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.184710 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184709 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.184901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184719 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzwwt\" (UniqueName: \"kubernetes.io/projected/60c48332-6af8-4618-b7b4-83ab26bd0ccb-kube-api-access-tzwwt\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.184901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184729 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.184901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184738 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.184901 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.184746 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/60c48332-6af8-4618-b7b4-83ab26bd0ccb-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:17:50.710370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.710331 2571 generic.go:356] "Generic (PLEG): container finished" podID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" containerID="9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c" exitCode=0 Jul 09 16:17:50.710883 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.710386 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d599864c-ns6fn" event={"ID":"60c48332-6af8-4618-b7b4-83ab26bd0ccb","Type":"ContainerDied","Data":"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c"} Jul 09 16:17:50.710883 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.710388 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d599864c-ns6fn" Jul 09 16:17:50.710883 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.710426 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d599864c-ns6fn" event={"ID":"60c48332-6af8-4618-b7b4-83ab26bd0ccb","Type":"ContainerDied","Data":"58cd763873aebd84ede448a34381dd5c685b1f20aa9ad5c00260e7c5a060d3a9"} Jul 09 16:17:50.710883 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.710446 2571 scope.go:117] "RemoveContainer" containerID="9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c" Jul 09 16:17:50.718519 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.718501 2571 scope.go:117] "RemoveContainer" containerID="9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c" Jul 09 16:17:50.718794 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:17:50.718757 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c\": container with ID starting with 9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c not found: ID does not exist" containerID="9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c" Jul 09 16:17:50.718879 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.718806 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c"} err="failed to get container status \"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c\": rpc error: code = NotFound desc = could not find container \"9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c\": container with ID starting with 9457e1af337cd9d49775c278137797e49520ee41548f8c31456cd0e7b455dd1c not found: ID does not exist" Jul 09 16:17:50.727314 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.727292 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:50.731081 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:50.731057 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d599864c-ns6fn"] Jul 09 16:17:52.134601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:17:52.134565 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" path="/var/lib/kubelet/pods/60c48332-6af8-4618-b7b4-83ab26bd0ccb/volumes" Jul 09 16:18:05.251422 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:05.251354 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:05.352657 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:05.352621 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:06.335079 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335047 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:06.335506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335357 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="alertmanager" containerID="cri-o://50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" gracePeriod=120 Jul 09 16:18:06.335506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335454 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="prom-label-proxy" containerID="cri-o://70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" gracePeriod=120 Jul 09 16:18:06.335506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335436 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-metric" containerID="cri-o://080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" gracePeriod=120 Jul 09 16:18:06.335506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335455 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-web" containerID="cri-o://fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" gracePeriod=120 Jul 09 16:18:06.335702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335463 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="config-reloader" containerID="cri-o://807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" gracePeriod=120 Jul 09 16:18:06.335702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.335570 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy" containerID="cri-o://f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" gracePeriod=120 Jul 09 16:18:06.774350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774313 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" exitCode=0 Jul 09 16:18:06.774350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774341 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" exitCode=0 Jul 09 16:18:06.774350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774348 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" exitCode=0 Jul 09 16:18:06.774350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774355 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" exitCode=0 Jul 09 16:18:06.774660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774380 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9"} Jul 09 16:18:06.774660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774460 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503"} Jul 09 16:18:06.774660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774502 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88"} Jul 09 16:18:06.774660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:06.774535 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f"} Jul 09 16:18:07.583105 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.583082 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:07.730868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730822 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730889 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730913 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730940 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730957 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.730974 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731011 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731040 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4zwf\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731289 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:18:07.731406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731365 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731403 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731429 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731460 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.731566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731494 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume\") pod \"1c702841-5c70-455c-aaf9-697c56006fc5\" (UID: \"1c702841-5c70-455c-aaf9-697c56006fc5\") " Jul 09 16:18:07.732234 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.731925 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-main-db\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.732557 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.732530 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:07.733162 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.732904 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:07.734286 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.734237 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.734616 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.734578 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.735249 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735221 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:18:07.735337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735255 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume" (OuterVolumeSpecName: "config-volume") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.735566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735541 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.735663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735633 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out" (OuterVolumeSpecName: "config-out") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:18:07.735734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735703 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf" (OuterVolumeSpecName: "kube-api-access-c4zwf") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "kube-api-access-c4zwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:18:07.735974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.735956 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.739071 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.739006 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.745588 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.745565 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config" (OuterVolumeSpecName: "web-config") pod "1c702841-5c70-455c-aaf9-697c56006fc5" (UID: "1c702841-5c70-455c-aaf9-697c56006fc5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:07.780919 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.780889 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" exitCode=0 Jul 09 16:18:07.780919 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.780913 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c702841-5c70-455c-aaf9-697c56006fc5" containerID="fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" exitCode=0 Jul 09 16:18:07.781096 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.781003 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55"} Jul 09 16:18:07.781096 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.781020 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:07.781096 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.781066 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52"} Jul 09 16:18:07.781096 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.781094 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c702841-5c70-455c-aaf9-697c56006fc5","Type":"ContainerDied","Data":"18483b7b0c8572941036bb03175a4b09e9a1f9950174dbdfc2838be6384348a7"} Jul 09 16:18:07.781213 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.781125 2571 scope.go:117] "RemoveContainer" containerID="70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" Jul 09 16:18:07.789121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.789102 2571 scope.go:117] "RemoveContainer" containerID="080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" Jul 09 16:18:07.796753 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.796735 2571 scope.go:117] "RemoveContainer" containerID="f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" Jul 09 16:18:07.803963 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.803938 2571 scope.go:117] "RemoveContainer" containerID="fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" Jul 09 16:18:07.808418 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.808396 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:07.811948 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.811848 2571 scope.go:117] "RemoveContainer" containerID="807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" Jul 09 16:18:07.813142 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.813124 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:07.819342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.819322 2571 scope.go:117] "RemoveContainer" containerID="50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" Jul 09 16:18:07.826704 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.826685 2571 scope.go:117] "RemoveContainer" containerID="33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197" Jul 09 16:18:07.833149 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833127 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833152 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4zwf\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-kube-api-access-c4zwf\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833177 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-web-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833189 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c702841-5c70-455c-aaf9-697c56006fc5-metrics-client-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833202 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833215 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c702841-5c70-455c-aaf9-697c56006fc5-config-out\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833229 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-config-volume\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833240 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-main-tls\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833252 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833265 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-cluster-tls-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833277 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c702841-5c70-455c-aaf9-697c56006fc5-tls-assets\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833294 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c702841-5c70-455c-aaf9-697c56006fc5-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:07.833833 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.833811 2571 scope.go:117] "RemoveContainer" containerID="70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" Jul 09 16:18:07.834164 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.834143 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9\": container with ID starting with 70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9 not found: ID does not exist" containerID="70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" Jul 09 16:18:07.834268 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834174 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9"} err="failed to get container status \"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9\": rpc error: code = NotFound desc = could not find container \"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9\": container with ID starting with 70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9 not found: ID does not exist" Jul 09 16:18:07.834268 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834194 2571 scope.go:117] "RemoveContainer" containerID="080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" Jul 09 16:18:07.834469 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.834435 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55\": container with ID starting with 080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55 not found: ID does not exist" containerID="080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" Jul 09 16:18:07.834539 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834465 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55"} err="failed to get container status \"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55\": rpc error: code = NotFound desc = could not find container \"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55\": container with ID starting with 080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55 not found: ID does not exist" Jul 09 16:18:07.834539 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834490 2571 scope.go:117] "RemoveContainer" containerID="f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" Jul 09 16:18:07.834761 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.834744 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503\": container with ID starting with f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503 not found: ID does not exist" containerID="f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" Jul 09 16:18:07.834822 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834795 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503"} err="failed to get container status \"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503\": rpc error: code = NotFound desc = could not find container \"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503\": container with ID starting with f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503 not found: ID does not exist" Jul 09 16:18:07.834822 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.834811 2571 scope.go:117] "RemoveContainer" containerID="fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" Jul 09 16:18:07.835073 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.835055 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52\": container with ID starting with fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52 not found: ID does not exist" containerID="fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" Jul 09 16:18:07.835140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835079 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52"} err="failed to get container status \"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52\": rpc error: code = NotFound desc = could not find container \"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52\": container with ID starting with fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52 not found: ID does not exist" Jul 09 16:18:07.835140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835101 2571 scope.go:117] "RemoveContainer" containerID="807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" Jul 09 16:18:07.835328 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.835313 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88\": container with ID starting with 807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88 not found: ID does not exist" containerID="807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" Jul 09 16:18:07.835362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835332 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88"} err="failed to get container status \"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88\": rpc error: code = NotFound desc = could not find container \"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88\": container with ID starting with 807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88 not found: ID does not exist" Jul 09 16:18:07.835362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835353 2571 scope.go:117] "RemoveContainer" containerID="50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" Jul 09 16:18:07.835574 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.835560 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f\": container with ID starting with 50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f not found: ID does not exist" containerID="50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" Jul 09 16:18:07.835619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835577 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f"} err="failed to get container status \"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f\": rpc error: code = NotFound desc = could not find container \"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f\": container with ID starting with 50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f not found: ID does not exist" Jul 09 16:18:07.835619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835592 2571 scope.go:117] "RemoveContainer" containerID="33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197" Jul 09 16:18:07.835801 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:07.835763 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197\": container with ID starting with 33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197 not found: ID does not exist" containerID="33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197" Jul 09 16:18:07.835868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835809 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197"} err="failed to get container status \"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197\": rpc error: code = NotFound desc = could not find container \"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197\": container with ID starting with 33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197 not found: ID does not exist" Jul 09 16:18:07.835868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.835829 2571 scope.go:117] "RemoveContainer" containerID="70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9" Jul 09 16:18:07.836047 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836032 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9"} err="failed to get container status \"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9\": rpc error: code = NotFound desc = could not find container \"70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9\": container with ID starting with 70f440eee59e06cc3e8c8db8670bc2d6d7a5f3f6f61bca3ab6724a74f7f4c9a9 not found: ID does not exist" Jul 09 16:18:07.836098 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836048 2571 scope.go:117] "RemoveContainer" containerID="080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55" Jul 09 16:18:07.836244 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836226 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55"} err="failed to get container status \"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55\": rpc error: code = NotFound desc = could not find container \"080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55\": container with ID starting with 080dc581b815ac1165fefabc9ab563af104c62199390416cde25062cbd9e6a55 not found: ID does not exist" Jul 09 16:18:07.836285 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836246 2571 scope.go:117] "RemoveContainer" containerID="f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503" Jul 09 16:18:07.836412 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836394 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503"} err="failed to get container status \"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503\": rpc error: code = NotFound desc = could not find container \"f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503\": container with ID starting with f014ec74879b9d32603fa3c73445d3e4fc6f0ad5a7d6ac50233369f19c3d6503 not found: ID does not exist" Jul 09 16:18:07.836412 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836412 2571 scope.go:117] "RemoveContainer" containerID="fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52" Jul 09 16:18:07.836583 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836567 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52"} err="failed to get container status \"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52\": rpc error: code = NotFound desc = could not find container \"fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52\": container with ID starting with fdc686089bf4c3ad509f850fc09bdf07383e6befe1d13129e093699682504d52 not found: ID does not exist" Jul 09 16:18:07.836622 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836583 2571 scope.go:117] "RemoveContainer" containerID="807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88" Jul 09 16:18:07.836760 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836745 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88"} err="failed to get container status \"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88\": rpc error: code = NotFound desc = could not find container \"807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88\": container with ID starting with 807f9bc9aff89817eaa81d9609f6bfb5b23145ba5423b23b35c2d942bee7bb88 not found: ID does not exist" Jul 09 16:18:07.836821 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836760 2571 scope.go:117] "RemoveContainer" containerID="50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f" Jul 09 16:18:07.836972 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836957 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f"} err="failed to get container status \"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f\": rpc error: code = NotFound desc = could not find container \"50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f\": container with ID starting with 50354ea01ece27a751af7cf1f88c62e2273564a703adb7233d660941f5cee62f not found: ID does not exist" Jul 09 16:18:07.837017 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.836973 2571 scope.go:117] "RemoveContainer" containerID="33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197" Jul 09 16:18:07.837185 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.837164 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197"} err="failed to get container status \"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197\": rpc error: code = NotFound desc = could not find container \"33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197\": container with ID starting with 33a5a0a36d1627bba9cbe73b6bc112f3046b6b9cd3004581ffbdf532b3d33197 not found: ID does not exist" Jul 09 16:18:07.849411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849383 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:07.849635 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849624 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="config-reloader" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849637 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="config-reloader" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849648 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-web" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849653 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-web" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849664 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="alertmanager" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849669 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="alertmanager" Jul 09 16:18:07.849680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849678 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="prom-label-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849683 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="prom-label-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849691 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="init-config-reloader" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849696 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="init-config-reloader" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849704 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849709 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849715 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" containerName="console" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849720 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" containerName="console" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849728 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-metric" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849733 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-metric" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849802 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="config-reloader" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849810 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849816 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="prom-label-proxy" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849830 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="alertmanager" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849836 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-web" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849842 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" containerName="kube-rbac-proxy-metric" Jul 09 16:18:07.849875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.849847 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c48332-6af8-4618-b7b4-83ab26bd0ccb" containerName="console" Jul 09 16:18:07.853460 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.853425 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:07.857041 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.857022 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 16:18:07.857161 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.857073 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 16:18:07.857511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.857492 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 16:18:07.857621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.857566 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rhqxp\"" Jul 09 16:18:07.857857 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.857841 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 16:18:07.858015 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.858000 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 16:18:07.858064 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.858022 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 16:18:07.858100 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.858073 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 16:18:07.858136 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.858101 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 16:18:07.868053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.868030 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 16:18:07.870078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:07.870051 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:08.035387 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035285 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035387 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035336 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035387 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035362 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035439 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-web-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035492 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035511 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035547 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035567 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035606 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkv45\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-kube-api-access-fkv45\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035638 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035659 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035683 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-config-out\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.035903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.035723 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.134306 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.134272 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c702841-5c70-455c-aaf9-697c56006fc5" path="/var/lib/kubelet/pods/1c702841-5c70-455c-aaf9-697c56006fc5/volumes" Jul 09 16:18:08.136652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136632 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.136810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136658 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.136810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136680 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-config-out\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.136810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136696 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.136810 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136720 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136861 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136901 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136928 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-web-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136958 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.136985 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.137041 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.137078 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.137106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkv45\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-kube-api-access-fkv45\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.137120 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.137980 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.137548 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.138482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.138458 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b644790-9eab-462f-8c31-c764d5e344f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.139977 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140035 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140050 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7b644790-9eab-462f-8c31-c764d5e344f3-config-out\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140180 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140262 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140373 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140298 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.140849 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.140829 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-web-config\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.141089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.141070 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.141988 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.141967 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7b644790-9eab-462f-8c31-c764d5e344f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.146337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.146309 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkv45\" (UniqueName: \"kubernetes.io/projected/7b644790-9eab-462f-8c31-c764d5e344f3-kube-api-access-fkv45\") pod \"alertmanager-main-0\" (UID: \"7b644790-9eab-462f-8c31-c764d5e344f3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.165362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.165328 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:18:08.309844 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.309748 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:18:08.312719 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:18:08.312693 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b644790_9eab_462f_8c31_c764d5e344f3.slice/crio-a4511e997f9827f355910d332d6ab1e12b5d95b29923864076197801832360c9 WatchSource:0}: Error finding container a4511e997f9827f355910d332d6ab1e12b5d95b29923864076197801832360c9: Status 404 returned error can't find the container with id a4511e997f9827f355910d332d6ab1e12b5d95b29923864076197801832360c9 Jul 09 16:18:08.787923 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.787888 2571 generic.go:356] "Generic (PLEG): container finished" podID="7b644790-9eab-462f-8c31-c764d5e344f3" containerID="e8beefec785e13be661cbb7bbde0b3f27f32274002e7e844e0b9c25588e5e6c0" exitCode=0 Jul 09 16:18:08.788317 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.787947 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerDied","Data":"e8beefec785e13be661cbb7bbde0b3f27f32274002e7e844e0b9c25588e5e6c0"} Jul 09 16:18:08.788317 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:08.788001 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"a4511e997f9827f355910d332d6ab1e12b5d95b29923864076197801832360c9"} Jul 09 16:18:09.797670 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797632 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"f3cecb0b8a41cdc0601bd3e1c69005f1de3ce519257109f448100369596ede6f"} Jul 09 16:18:09.798201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797723 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"66b89d1b68af8b4595f6e721b5a56de2e78227b76bd312c2c57348a1f93bd28a"} Jul 09 16:18:09.798201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797750 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"41a149ffb578f69541e12c5cef3e81ee9550d6439cda05049236067795668b9d"} Jul 09 16:18:09.798201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797799 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"9d4fe975a483790009e1fa09a424462b06f0332d6a6538bc6eb04a86da5322da"} Jul 09 16:18:09.798201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797820 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"743aac5bc22a08d1927451eb48221ff00a84c39ba51af5d0c0d95d24c5b52b97"} Jul 09 16:18:09.798201 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.797852 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7b644790-9eab-462f-8c31-c764d5e344f3","Type":"ContainerStarted","Data":"8be193b771516b0d2c2b7e0ee1f50d6a65751da7005f5e1a310d88ea376a2ad2"} Jul 09 16:18:09.823739 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:09.823674 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.806983175 podStartE2EDuration="2.82365332s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.670145ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:18:09.82181831 +0000 UTC m=+144.210300698" watchObservedRunningTime="2026-07-09 16:18:09.82365332 +0000 UTC m=+144.212135723" Jul 09 16:18:10.335800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.335748 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86cfb68547-f9wbr"] Jul 09 16:18:10.338973 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.338952 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.341448 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341424 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qgwmg\"" Jul 09 16:18:10.341586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341483 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 16:18:10.341586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341544 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 16:18:10.341716 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341620 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 16:18:10.341716 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341658 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 16:18:10.341882 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.341723 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 16:18:10.348375 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.348350 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 16:18:10.351026 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.351003 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86cfb68547-f9wbr"] Jul 09 16:18:10.457187 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457152 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457196 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-metrics-client-ca\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457257 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457319 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-serving-certs-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-federate-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457370 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457401 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.457530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.457439 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v76v\" (UniqueName: \"kubernetes.io/projected/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-kube-api-access-9v76v\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558444 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558636 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558484 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-serving-certs-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558636 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558505 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-federate-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558636 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558522 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558756 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558655 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558756 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558698 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v76v\" (UniqueName: \"kubernetes.io/projected/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-kube-api-access-9v76v\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558790 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.558880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.558812 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-metrics-client-ca\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.559562 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.559529 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-serving-certs-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.559851 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.559830 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.559931 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.559883 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-metrics-client-ca\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.561239 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.561213 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-federate-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.561330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.561310 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-telemeter-client-tls\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.561863 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.561844 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.561950 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.561863 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.567374 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.567350 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v76v\" (UniqueName: \"kubernetes.io/projected/3707f3f0-ad87-436c-ba06-d3c5d7c976c2-kube-api-access-9v76v\") pod \"telemeter-client-86cfb68547-f9wbr\" (UID: \"3707f3f0-ad87-436c-ba06-d3c5d7c976c2\") " pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.651027 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.650946 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" Jul 09 16:18:10.819820 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:10.819792 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86cfb68547-f9wbr"] Jul 09 16:18:10.823290 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:18:10.823263 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3707f3f0_ad87_436c_ba06_d3c5d7c976c2.slice/crio-865e677551361103ce8098f4d11ed15033b48228aea8a21b220c1ce55ea433b6 WatchSource:0}: Error finding container 865e677551361103ce8098f4d11ed15033b48228aea8a21b220c1ce55ea433b6: Status 404 returned error can't find the container with id 865e677551361103ce8098f4d11ed15033b48228aea8a21b220c1ce55ea433b6 Jul 09 16:18:11.807325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:11.807292 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" event={"ID":"3707f3f0-ad87-436c-ba06-d3c5d7c976c2","Type":"ContainerStarted","Data":"865e677551361103ce8098f4d11ed15033b48228aea8a21b220c1ce55ea433b6"} Jul 09 16:18:13.816801 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:13.816747 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" event={"ID":"3707f3f0-ad87-436c-ba06-d3c5d7c976c2","Type":"ContainerStarted","Data":"94bfca8850134b1caffa32954336413108c0710364eb2f7882e053fc461865aa"} Jul 09 16:18:13.817164 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:13.816821 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" event={"ID":"3707f3f0-ad87-436c-ba06-d3c5d7c976c2","Type":"ContainerStarted","Data":"8e9928d494018969280a60f4ba12f072a6cb55c3739b21591d4146fb82ca9ec8"} Jul 09 16:18:13.817164 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:13.816848 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" event={"ID":"3707f3f0-ad87-436c-ba06-d3c5d7c976c2","Type":"ContainerStarted","Data":"0de26a2a96c488a72fb43c426a90453e4e5e63ae8d352e8af66e01e5882c3c28"} Jul 09 16:18:13.841139 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:13.841070 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86cfb68547-f9wbr" podStartSLOduration=1.626917604 podStartE2EDuration="3.84104888s" totalImagesPullingTime="2.214131276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:18:13.839695293 +0000 UTC m=+148.228177694" watchObservedRunningTime="2026-07-09 16:18:13.84104888 +0000 UTC m=+148.229531271" Jul 09 16:18:14.652477 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.652438 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:18:14.655036 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.655016 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.668132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.668106 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:18:14.717384 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.717348 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:14.778029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.777997 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:14.795130 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795130 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795146 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795162 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795261 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795316 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.795362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.795337 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnbzf\" (UniqueName: \"kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.842264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.842178 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:14.895865 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895830 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895883 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnbzf\" (UniqueName: \"kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895931 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895964 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.895994 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896717 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.896685 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.896763 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.896853 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.896836 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.897046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.897023 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.898601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.898578 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.898685 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.898584 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.903342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.903236 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:14.904617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.904596 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnbzf\" (UniqueName: \"kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf\") pod \"console-598f5f468-dmhg2\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:14.965234 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:14.965197 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:15.098180 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:15.098157 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:18:15.100241 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:18:15.100215 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3e6c79_b71a_43eb_90c2_4f9899365571.slice/crio-d4e35feeb1c9a9ff381efc8191f5e82acf9c88213c8906acb07947205826ad4b WatchSource:0}: Error finding container d4e35feeb1c9a9ff381efc8191f5e82acf9c88213c8906acb07947205826ad4b: Status 404 returned error can't find the container with id d4e35feeb1c9a9ff381efc8191f5e82acf9c88213c8906acb07947205826ad4b Jul 09 16:18:15.442748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:15.442642 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:15.826970 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:15.826886 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598f5f468-dmhg2" event={"ID":"ba3e6c79-b71a-43eb-90c2-4f9899365571","Type":"ContainerStarted","Data":"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c"} Jul 09 16:18:15.826970 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:15.826941 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598f5f468-dmhg2" event={"ID":"ba3e6c79-b71a-43eb-90c2-4f9899365571","Type":"ContainerStarted","Data":"d4e35feeb1c9a9ff381efc8191f5e82acf9c88213c8906acb07947205826ad4b"} Jul 09 16:18:15.847078 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:15.847027 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-598f5f468-dmhg2" podStartSLOduration=1.847011143 podStartE2EDuration="1.847011143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:18:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:18:15.845866381 +0000 UTC m=+150.234348772" watchObservedRunningTime="2026-07-09 16:18:15.847011143 +0000 UTC m=+150.235493532" Jul 09 16:18:16.377450 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:16.377387 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:24.965931 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:24.965890 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:24.966367 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:24.965963 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:24.970876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:24.970849 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:25.868200 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:25.868169 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:18:25.917641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:25.917611 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:18:26.045895 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:26.045862 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:27.006813 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:27.006765 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:27.072219 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:27.072173 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:49.940331 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:49.940297 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:49.999831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:49.999792 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:18:50.938543 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:50.938506 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d7897b5fb-555tk" podUID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" containerName="console" containerID="cri-o://7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e" gracePeriod=15 Jul 09 16:18:51.169141 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.169116 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:18:51.299937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299839 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.299937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299882 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.299937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299903 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.299937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299925 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.300275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299976 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.300275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.299999 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.300275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.300052 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msgw9\" (UniqueName: \"kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9\") pod \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\" (UID: \"9e79be0e-dc63-429f-8c2f-7b53f34225f4\") " Jul 09 16:18:51.300423 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.300363 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config" (OuterVolumeSpecName: "console-config") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:51.300489 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.300451 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:51.300531 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.300479 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:51.300576 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.300549 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:18:51.302492 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.302471 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9" (OuterVolumeSpecName: "kube-api-access-msgw9") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "kube-api-access-msgw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:18:51.302687 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.302667 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:51.302740 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.302687 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e79be0e-dc63-429f-8c2f-7b53f34225f4" (UID: "9e79be0e-dc63-429f-8c2f-7b53f34225f4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:18:51.401133 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401097 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401133 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401126 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401133 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401134 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401133 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401144 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msgw9\" (UniqueName: \"kubernetes.io/projected/9e79be0e-dc63-429f-8c2f-7b53f34225f4-kube-api-access-msgw9\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401389 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401153 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401389 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401161 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.401389 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.401169 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e79be0e-dc63-429f-8c2f-7b53f34225f4-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:18:51.964361 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.964325 2571 generic.go:356] "Generic (PLEG): container finished" podID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" containerID="7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e" exitCode=0 Jul 09 16:18:51.964549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.964370 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7897b5fb-555tk" Jul 09 16:18:51.964549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.964374 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7897b5fb-555tk" event={"ID":"9e79be0e-dc63-429f-8c2f-7b53f34225f4","Type":"ContainerDied","Data":"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e"} Jul 09 16:18:51.964549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.964431 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7897b5fb-555tk" event={"ID":"9e79be0e-dc63-429f-8c2f-7b53f34225f4","Type":"ContainerDied","Data":"7e2d539420a2cbaa72a0bdf0ed82cb480cc149d420760b3bdbde2a48d2e09211"} Jul 09 16:18:51.964549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.964460 2571 scope.go:117] "RemoveContainer" containerID="7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e" Jul 09 16:18:51.973035 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.973018 2571 scope.go:117] "RemoveContainer" containerID="7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e" Jul 09 16:18:51.973294 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:18:51.973276 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e\": container with ID starting with 7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e not found: ID does not exist" containerID="7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e" Jul 09 16:18:51.973340 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.973305 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e"} err="failed to get container status \"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e\": rpc error: code = NotFound desc = could not find container \"7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e\": container with ID starting with 7b536ad01d6d709a713fc8b3d63e9f3e45ef6aa7180709638eae47ba22c2ad0e not found: ID does not exist" Jul 09 16:18:51.985733 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.985709 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:18:51.989313 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:51.989291 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d7897b5fb-555tk"] Jul 09 16:18:52.134369 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:18:52.134332 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" path="/var/lib/kubelet/pods/9e79be0e-dc63-429f-8c2f-7b53f34225f4/volumes" Jul 09 16:19:20.529257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:20.529221 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:20.602353 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:20.602322 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:21.427743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.427716 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:19:21.428049 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.428037 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" containerName="console" Jul 09 16:19:21.428091 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.428052 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" containerName="console" Jul 09 16:19:21.428124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.428118 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e79be0e-dc63-429f-8c2f-7b53f34225f4" containerName="console" Jul 09 16:19:21.430058 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.430043 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.442845 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.442822 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:19:21.488123 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.488091 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:21.539358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539321 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539359 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539397 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539456 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn6dk\" (UniqueName: \"kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.539761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.539589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640157 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640201 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640238 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640262 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn6dk\" (UniqueName: \"kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640283 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640348 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640638 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640496 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.640978 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.640954 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.641265 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.641155 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.641265 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.641155 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.641407 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.641381 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.642976 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.642955 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.643172 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.643153 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.649440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.649416 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn6dk\" (UniqueName: \"kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk\") pod \"console-765556458b-zzhp8\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.739555 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.739464 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:21.867674 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:21.867651 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:19:21.869908 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:19:21.869878 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd82a4e_8c5f_44f2_afa6_3cd71eb8f669.slice/crio-3d1fa212bea24fe65d3bfb2c7b74dc002859bbfdab27f80c2bad9fd032d90efa WatchSource:0}: Error finding container 3d1fa212bea24fe65d3bfb2c7b74dc002859bbfdab27f80c2bad9fd032d90efa: Status 404 returned error can't find the container with id 3d1fa212bea24fe65d3bfb2c7b74dc002859bbfdab27f80c2bad9fd032d90efa Jul 09 16:19:22.073413 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:22.073324 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765556458b-zzhp8" event={"ID":"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669","Type":"ContainerStarted","Data":"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f"} Jul 09 16:19:22.073413 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:22.073383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765556458b-zzhp8" event={"ID":"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669","Type":"ContainerStarted","Data":"3d1fa212bea24fe65d3bfb2c7b74dc002859bbfdab27f80c2bad9fd032d90efa"} Jul 09 16:19:22.649303 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:22.649265 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:29.570072 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:29.570035 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:31.740232 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:31.740195 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:31.740680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:31.740246 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:31.744923 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:31.744902 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:31.764175 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:31.764126 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-765556458b-zzhp8" podStartSLOduration=10.764110843 podStartE2EDuration="10.764110843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:19:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:19:22.097584714 +0000 UTC m=+216.486067103" watchObservedRunningTime="2026-07-09 16:19:31.764110843 +0000 UTC m=+226.152593231" Jul 09 16:19:32.118592 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.118513 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:19:32.166025 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.165996 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:19:32.276403 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.276377 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:32.330985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.330952 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:32.496894 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.496866 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:32.562074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:32.562044 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:44.446203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:44.446162 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:44.531621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:44.531585 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:19:58.144445 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.144380 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-598f5f468-dmhg2" podUID="ba3e6c79-b71a-43eb-90c2-4f9899365571" containerName="console" containerID="cri-o://c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c" gracePeriod=15 Jul 09 16:19:58.386421 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.386395 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:19:58.558129 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558091 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558164 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnbzf\" (UniqueName: \"kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558192 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558284 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558495 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558351 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558495 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558376 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558495 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558405 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config\") pod \"ba3e6c79-b71a-43eb-90c2-4f9899365571\" (UID: \"ba3e6c79-b71a-43eb-90c2-4f9899365571\") " Jul 09 16:19:58.558495 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558487 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:19:58.558805 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558749 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:19:58.558805 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558759 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config" (OuterVolumeSpecName: "console-config") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:19:58.559029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558796 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.559029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.558810 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:19:58.560594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.560570 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf" (OuterVolumeSpecName: "kube-api-access-fnbzf") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "kube-api-access-fnbzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:19:58.560688 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.560590 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:19:58.560688 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.560604 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba3e6c79-b71a-43eb-90c2-4f9899365571" (UID: "ba3e6c79-b71a-43eb-90c2-4f9899365571"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:19:58.660097 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660050 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnbzf\" (UniqueName: \"kubernetes.io/projected/ba3e6c79-b71a-43eb-90c2-4f9899365571-kube-api-access-fnbzf\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.660097 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660092 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.660097 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660102 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.660097 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660111 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.660361 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660120 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:58.660361 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:58.660128 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba3e6c79-b71a-43eb-90c2-4f9899365571-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:19:59.219501 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.219459 2571 generic.go:356] "Generic (PLEG): container finished" podID="ba3e6c79-b71a-43eb-90c2-4f9899365571" containerID="c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c" exitCode=0 Jul 09 16:19:59.219501 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.219505 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-598f5f468-dmhg2" Jul 09 16:19:59.219960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.219525 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598f5f468-dmhg2" event={"ID":"ba3e6c79-b71a-43eb-90c2-4f9899365571","Type":"ContainerDied","Data":"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c"} Jul 09 16:19:59.219960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.219576 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-598f5f468-dmhg2" event={"ID":"ba3e6c79-b71a-43eb-90c2-4f9899365571","Type":"ContainerDied","Data":"d4e35feeb1c9a9ff381efc8191f5e82acf9c88213c8906acb07947205826ad4b"} Jul 09 16:19:59.219960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.219604 2571 scope.go:117] "RemoveContainer" containerID="c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c" Jul 09 16:19:59.228243 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.228227 2571 scope.go:117] "RemoveContainer" containerID="c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c" Jul 09 16:19:59.228514 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:19:59.228496 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c\": container with ID starting with c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c not found: ID does not exist" containerID="c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c" Jul 09 16:19:59.228557 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.228524 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c"} err="failed to get container status \"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c\": rpc error: code = NotFound desc = could not find container \"c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c\": container with ID starting with c5845c99e83da30e1cb165ffcf7e51de5d911b48242b574da1863c7aff74eb1c not found: ID does not exist" Jul 09 16:19:59.240553 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.240518 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:19:59.244160 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:19:59.244133 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-598f5f468-dmhg2"] Jul 09 16:20:00.134332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:00.134302 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3e6c79-b71a-43eb-90c2-4f9899365571" path="/var/lib/kubelet/pods/ba3e6c79-b71a-43eb-90c2-4f9899365571/volumes" Jul 09 16:20:07.671480 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:07.671370 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:07.769242 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:07.769208 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:08.445295 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.445265 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x"] Jul 09 16:20:08.445617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.445604 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3e6c79-b71a-43eb-90c2-4f9899365571" containerName="console" Jul 09 16:20:08.445665 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.445619 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3e6c79-b71a-43eb-90c2-4f9899365571" containerName="console" Jul 09 16:20:08.445698 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.445683 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba3e6c79-b71a-43eb-90c2-4f9899365571" containerName="console" Jul 09 16:20:08.448638 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.448620 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.451237 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.451211 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:20:08.451237 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.451233 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9xd\"" Jul 09 16:20:08.452379 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.452348 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:20:08.457314 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.457294 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x"] Jul 09 16:20:08.535144 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.535104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8lfd\" (UniqueName: \"kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.535336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.535160 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.535336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.535225 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.635883 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.635839 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8lfd\" (UniqueName: \"kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.636043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.635913 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.636043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.635939 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.636260 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.636239 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.636322 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.636291 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.644252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.644230 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8lfd\" (UniqueName: \"kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.758388 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.758300 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:08.889813 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:08.889757 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x"] Jul 09 16:20:08.893466 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:08.893438 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbf8771_dc57_4432_ac79_194edac19b7d.slice/crio-4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70 WatchSource:0}: Error finding container 4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70: Status 404 returned error can't find the container with id 4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70 Jul 09 16:20:09.261191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:09.261154 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" event={"ID":"8cbf8771-dc57-4432-ac79-194edac19b7d","Type":"ContainerStarted","Data":"4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70"} Jul 09 16:20:14.283788 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:14.283746 2571 generic.go:356] "Generic (PLEG): container finished" podID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerID="641fa720b05dfdf2a371950b4ff387189e08143ee3abdadb333d28b45b2a042f" exitCode=0 Jul 09 16:20:14.284231 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:14.283806 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" event={"ID":"8cbf8771-dc57-4432-ac79-194edac19b7d","Type":"ContainerDied","Data":"641fa720b05dfdf2a371950b4ff387189e08143ee3abdadb333d28b45b2a042f"} Jul 09 16:20:17.297982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:17.297949 2571 generic.go:356] "Generic (PLEG): container finished" podID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerID="ee38976640694f80fa92282f8a6fe49d0ef178751629cb69633e5642ed4e97f6" exitCode=0 Jul 09 16:20:17.298418 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:17.298029 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" event={"ID":"8cbf8771-dc57-4432-ac79-194edac19b7d","Type":"ContainerDied","Data":"ee38976640694f80fa92282f8a6fe49d0ef178751629cb69633e5642ed4e97f6"} Jul 09 16:20:23.326199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:23.326166 2571 generic.go:356] "Generic (PLEG): container finished" podID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerID="86bf812e1c9357da4d4a86f62dc036d3141b044c9c508f9c51bc361bd84fab7d" exitCode=0 Jul 09 16:20:23.326541 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:23.326226 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" event={"ID":"8cbf8771-dc57-4432-ac79-194edac19b7d","Type":"ContainerDied","Data":"86bf812e1c9357da4d4a86f62dc036d3141b044c9c508f9c51bc361bd84fab7d"} Jul 09 16:20:24.450712 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.450684 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:24.575534 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.575501 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util\") pod \"8cbf8771-dc57-4432-ac79-194edac19b7d\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " Jul 09 16:20:24.575700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.575550 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle\") pod \"8cbf8771-dc57-4432-ac79-194edac19b7d\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " Jul 09 16:20:24.575700 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.575588 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8lfd\" (UniqueName: \"kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd\") pod \"8cbf8771-dc57-4432-ac79-194edac19b7d\" (UID: \"8cbf8771-dc57-4432-ac79-194edac19b7d\") " Jul 09 16:20:24.576339 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.576286 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle" (OuterVolumeSpecName: "bundle") pod "8cbf8771-dc57-4432-ac79-194edac19b7d" (UID: "8cbf8771-dc57-4432-ac79-194edac19b7d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:24.577985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.577951 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd" (OuterVolumeSpecName: "kube-api-access-w8lfd") pod "8cbf8771-dc57-4432-ac79-194edac19b7d" (UID: "8cbf8771-dc57-4432-ac79-194edac19b7d"). InnerVolumeSpecName "kube-api-access-w8lfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:20:24.579509 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.579490 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util" (OuterVolumeSpecName: "util") pod "8cbf8771-dc57-4432-ac79-194edac19b7d" (UID: "8cbf8771-dc57-4432-ac79-194edac19b7d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:24.676479 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.676445 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8lfd\" (UniqueName: \"kubernetes.io/projected/8cbf8771-dc57-4432-ac79-194edac19b7d-kube-api-access-w8lfd\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:24.676479 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.676474 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:24.676479 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:24.676486 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cbf8771-dc57-4432-ac79-194edac19b7d-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:25.335494 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:25.335468 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" Jul 09 16:20:25.335494 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:25.335488 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bhm7x" event={"ID":"8cbf8771-dc57-4432-ac79-194edac19b7d","Type":"ContainerDied","Data":"4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70"} Jul 09 16:20:25.335705 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:25.335538 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ccb51b2a2d9dfe91ce13ddeaf815f5d012d87c97f7fc4a2eb8b2f9dda449f70" Jul 09 16:20:29.696639 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:29.696608 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:31.208642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.208606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:31.814703 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.814666 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx"] Jul 09 16:20:31.814990 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.814977 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="util" Jul 09 16:20:31.815045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.814992 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="util" Jul 09 16:20:31.815045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.815005 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="pull" Jul 09 16:20:31.815045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.815011 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="pull" Jul 09 16:20:31.815045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.815024 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="extract" Jul 09 16:20:31.815045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.815030 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="extract" Jul 09 16:20:31.815210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.815073 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cbf8771-dc57-4432-ac79-194edac19b7d" containerName="extract" Jul 09 16:20:31.817072 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.817055 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:31.819802 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.819763 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:20:31.819935 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.819763 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 16:20:31.820146 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.820133 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cgwzq\"" Jul 09 16:20:31.837045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.837019 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx"] Jul 09 16:20:31.939089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.939056 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79409bc-dff9-478c-8474-d9d699bb24b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:31.939244 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:31.939110 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k622l\" (UniqueName: \"kubernetes.io/projected/e79409bc-dff9-478c-8474-d9d699bb24b9-kube-api-access-k622l\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.040365 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.040328 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79409bc-dff9-478c-8474-d9d699bb24b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.040488 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.040388 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k622l\" (UniqueName: \"kubernetes.io/projected/e79409bc-dff9-478c-8474-d9d699bb24b9-kube-api-access-k622l\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.040710 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.040693 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e79409bc-dff9-478c-8474-d9d699bb24b9-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.051529 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.051505 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k622l\" (UniqueName: \"kubernetes.io/projected/e79409bc-dff9-478c-8474-d9d699bb24b9-kube-api-access-k622l\") pod \"cert-manager-operator-controller-manager-55c444bf86-blgnx\" (UID: \"e79409bc-dff9-478c-8474-d9d699bb24b9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.127210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.127125 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" Jul 09 16:20:32.262254 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.262226 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx"] Jul 09 16:20:32.265679 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:32.265652 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79409bc_dff9_478c_8474_d9d699bb24b9.slice/crio-91411c19caf3513875bbda5d617b4e8bf5d4a20dca36802f6d7e37e7bc37751b WatchSource:0}: Error finding container 91411c19caf3513875bbda5d617b4e8bf5d4a20dca36802f6d7e37e7bc37751b: Status 404 returned error can't find the container with id 91411c19caf3513875bbda5d617b4e8bf5d4a20dca36802f6d7e37e7bc37751b Jul 09 16:20:32.362746 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:32.362709 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" event={"ID":"e79409bc-dff9-478c-8474-d9d699bb24b9","Type":"ContainerStarted","Data":"91411c19caf3513875bbda5d617b4e8bf5d4a20dca36802f6d7e37e7bc37751b"} Jul 09 16:20:33.797899 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:33.797859 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:33.961674 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:33.961596 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:34.538474 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:34.538442 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:35.287478 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.287450 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:35.376191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.376147 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" event={"ID":"e79409bc-dff9-478c-8474-d9d699bb24b9","Type":"ContainerStarted","Data":"faaea547b2944aba47db163360f4cdd903e8c3f2704a9a9b638edf11299ef1fd"} Jul 09 16:20:35.414556 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.414485 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-blgnx" podStartSLOduration=2.338677797 podStartE2EDuration="4.414465584s" totalImagesPullingTime="2.075787787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:35.413109967 +0000 UTC m=+289.801592353" watchObservedRunningTime="2026-07-09 16:20:35.414465584 +0000 UTC m=+289.802947973" Jul 09 16:20:35.437373 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.437340 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:35.499535 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.499505 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-992v6"] Jul 09 16:20:35.502758 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.502739 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.509230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.509209 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 16:20:35.509327 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.509241 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 16:20:35.509327 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.509209 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5dkjr\"" Jul 09 16:20:35.521467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.521442 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-992v6"] Jul 09 16:20:35.572965 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.572876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7j4\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-kube-api-access-5p7j4\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.572965 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.572921 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.674238 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.674200 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.674411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.674295 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7j4\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-kube-api-access-5p7j4\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.687332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.687304 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7j4\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-kube-api-access-5p7j4\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.690640 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.690619 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8513574a-34f6-451e-9061-72672df3febf-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-992v6\" (UID: \"8513574a-34f6-451e-9061-72672df3febf\") " pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.826277 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.826192 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:35.920927 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.920894 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:35.973638 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:35.973603 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-992v6"] Jul 09 16:20:35.975832 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:35.975804 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8513574a_34f6_451e_9061_72672df3febf.slice/crio-f8d61737f207e5fc3429a322276abd5f07f2a3b87ff3a19eed47c2de465978a8 WatchSource:0}: Error finding container f8d61737f207e5fc3429a322276abd5f07f2a3b87ff3a19eed47c2de465978a8: Status 404 returned error can't find the container with id f8d61737f207e5fc3429a322276abd5f07f2a3b87ff3a19eed47c2de465978a8 Jul 09 16:20:36.046592 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.046558 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:36.351566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.351526 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8"] Jul 09 16:20:36.356111 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.356087 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.360214 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.360195 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:20:36.360443 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.360428 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9xd\"" Jul 09 16:20:36.361094 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.361080 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:20:36.369713 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.369689 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8"] Jul 09 16:20:36.382145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.382120 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" event={"ID":"8513574a-34f6-451e-9061-72672df3febf","Type":"ContainerStarted","Data":"f8d61737f207e5fc3429a322276abd5f07f2a3b87ff3a19eed47c2de465978a8"} Jul 09 16:20:36.481065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.481025 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.481065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.481070 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.481306 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.481128 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvddr\" (UniqueName: \"kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.582334 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.582297 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.582334 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.582335 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvddr\" (UniqueName: \"kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.582603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.582409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.582803 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.582753 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.582868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.582815 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.636172 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.636090 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvddr\" (UniqueName: \"kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.665978 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.665944 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:36.830083 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:36.826586 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8"] Jul 09 16:20:37.388689 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:37.388654 2571 generic.go:356] "Generic (PLEG): container finished" podID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerID="78d1cee6c116e7190c4d72de107affc6d3bdb6d37b566f314b4b0b6efbd00b5c" exitCode=0 Jul 09 16:20:37.389134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:37.388694 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" event={"ID":"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f","Type":"ContainerDied","Data":"78d1cee6c116e7190c4d72de107affc6d3bdb6d37b566f314b4b0b6efbd00b5c"} Jul 09 16:20:37.389134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:37.388758 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" event={"ID":"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f","Type":"ContainerStarted","Data":"5bbb736ac44b811b9e19d714e246a13b17efefc85b96d1f69805b71f1dcb6939"} Jul 09 16:20:37.514957 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:37.514911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:37.724089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:37.724033 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:40.405286 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.405251 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" event={"ID":"8513574a-34f6-451e-9061-72672df3febf","Type":"ContainerStarted","Data":"0fb6e57bcb9b9e0c95e2fdf680393c4c12a22b31ac4154de641be077beadd3e7"} Jul 09 16:20:40.405720 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.405330 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:40.407134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.407111 2571 generic.go:356] "Generic (PLEG): container finished" podID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerID="184a0734eed2535b686b39e00481dc94d5d29d5a4f00ec146a30fbef2b95c2b5" exitCode=0 Jul 09 16:20:40.407228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.407169 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" event={"ID":"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f","Type":"ContainerDied","Data":"184a0734eed2535b686b39e00481dc94d5d29d5a4f00ec146a30fbef2b95c2b5"} Jul 09 16:20:40.441681 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.441620 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" podStartSLOduration=1.901863621 podStartE2EDuration="5.44160376s" totalImagesPullingTime="3.539740139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:40.441062929 +0000 UTC m=+294.829545320" watchObservedRunningTime="2026-07-09 16:20:40.44160376 +0000 UTC m=+294.830086149" Jul 09 16:20:40.761179 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.761134 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:40.890360 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:40.890320 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:41.413520 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.413489 2571 generic.go:356] "Generic (PLEG): container finished" podID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerID="90b17f8cc9eed384c4ee7dbf41287170f04620b92be1af25e2c05b2c39cf0a1c" exitCode=0 Jul 09 16:20:41.413935 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.413571 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" event={"ID":"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f","Type":"ContainerDied","Data":"90b17f8cc9eed384c4ee7dbf41287170f04620b92be1af25e2c05b2c39cf0a1c"} Jul 09 16:20:41.944705 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.944674 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb"] Jul 09 16:20:41.947873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.947845 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:41.951213 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.951190 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xsv52\"" Jul 09 16:20:41.965381 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:41.965348 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb"] Jul 09 16:20:42.136531 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.136491 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.136531 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.136527 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27cft\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-kube-api-access-27cft\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.237179 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.237085 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.237179 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.237134 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27cft\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-kube-api-access-27cft\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.261662 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.261621 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.261827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.261706 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27cft\" (UniqueName: \"kubernetes.io/projected/74f678af-1b64-4063-8f3f-663f1a0232b4-kube-api-access-27cft\") pod \"cert-manager-cainjector-559cdd8c87-m7vpb\" (UID: \"74f678af-1b64-4063-8f3f-663f1a0232b4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.543705 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.543678 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:42.557063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.557033 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" Jul 09 16:20:42.640176 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.640150 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle\") pod \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " Jul 09 16:20:42.640337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.640184 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvddr\" (UniqueName: \"kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr\") pod \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " Jul 09 16:20:42.640337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.640252 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util\") pod \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\" (UID: \"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f\") " Jul 09 16:20:42.640589 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.640499 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle" (OuterVolumeSpecName: "bundle") pod "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" (UID: "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:42.643132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.642990 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr" (OuterVolumeSpecName: "kube-api-access-tvddr") pod "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" (UID: "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f"). InnerVolumeSpecName "kube-api-access-tvddr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:20:42.646595 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.646566 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util" (OuterVolumeSpecName: "util") pod "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" (UID: "8e2493e6-a2fd-4a4f-a482-8a1de7abf38f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:42.707029 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.706993 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb"] Jul 09 16:20:42.710451 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:42.710413 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74f678af_1b64_4063_8f3f_663f1a0232b4.slice/crio-c1932da4a46dc12a822ea2f8152ac73af561bac92e739e328278b3c6749d12be WatchSource:0}: Error finding container c1932da4a46dc12a822ea2f8152ac73af561bac92e739e328278b3c6749d12be: Status 404 returned error can't find the container with id c1932da4a46dc12a822ea2f8152ac73af561bac92e739e328278b3c6749d12be Jul 09 16:20:42.741370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.741348 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:42.741370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.741371 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvddr\" (UniqueName: \"kubernetes.io/projected/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-kube-api-access-tvddr\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:42.741518 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:42.741380 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e2493e6-a2fd-4a4f-a482-8a1de7abf38f-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:43.428949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.428908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" event={"ID":"8e2493e6-a2fd-4a4f-a482-8a1de7abf38f","Type":"ContainerDied","Data":"5bbb736ac44b811b9e19d714e246a13b17efefc85b96d1f69805b71f1dcb6939"} Jul 09 16:20:43.428949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.428938 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwxwv8" Jul 09 16:20:43.429208 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.429002 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bbb736ac44b811b9e19d714e246a13b17efefc85b96d1f69805b71f1dcb6939" Jul 09 16:20:43.430467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.430439 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" event={"ID":"74f678af-1b64-4063-8f3f-663f1a0232b4","Type":"ContainerStarted","Data":"f47acb4032a24a2262ea5b00d430f26a7dc55895e8d3c2aa7e5c560401f59998"} Jul 09 16:20:43.430467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.430470 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" event={"ID":"74f678af-1b64-4063-8f3f-663f1a0232b4","Type":"ContainerStarted","Data":"c1932da4a46dc12a822ea2f8152ac73af561bac92e739e328278b3c6749d12be"} Jul 09 16:20:43.453489 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.453446 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m7vpb" podStartSLOduration=2.453431369 podStartE2EDuration="2.453431369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:43.451331363 +0000 UTC m=+297.839813751" watchObservedRunningTime="2026-07-09 16:20:43.453431369 +0000 UTC m=+297.841913758" Jul 09 16:20:43.641862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.641745 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:43.749284 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:43.749251 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:45.135128 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.135094 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:45.679315 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679279 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph4pn"] Jul 09 16:20:45.679591 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679579 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="pull" Jul 09 16:20:45.679641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679592 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="pull" Jul 09 16:20:45.679641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679599 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="extract" Jul 09 16:20:45.679641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679605 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="extract" Jul 09 16:20:45.679641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679617 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="util" Jul 09 16:20:45.679641 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679622 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="util" Jul 09 16:20:45.679802 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.679693 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e2493e6-a2fd-4a4f-a482-8a1de7abf38f" containerName="extract" Jul 09 16:20:45.696888 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.696865 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.700060 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.700040 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jq2fx\"" Jul 09 16:20:45.704747 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.704725 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph4pn"] Jul 09 16:20:45.867695 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.867658 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxhl\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-kube-api-access-7lxhl\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.867907 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.867759 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.968148 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.968063 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxhl\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-kube-api-access-7lxhl\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.968305 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.968164 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.979025 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.978998 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.979187 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.979064 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxhl\" (UniqueName: \"kubernetes.io/projected/fe1d8e86-0c1a-4266-bf9d-9946da6d184c-kube-api-access-7lxhl\") pod \"cert-manager-55b4d954d5-ph4pn\" (UID: \"fe1d8e86-0c1a-4266-bf9d-9946da6d184c\") " pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:45.979187 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.979098 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:20:45.979353 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.979230 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:20:45.984615 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:45.984595 2571 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 16:20:46.009374 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.009354 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jq2fx\"" Jul 09 16:20:46.017219 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.017201 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ph4pn" Jul 09 16:20:46.171708 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.152385 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph4pn"] Jul 09 16:20:46.171708 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:46.154174 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe1d8e86_0c1a_4266_bf9d_9946da6d184c.slice/crio-92118dfd29a994ddc1d1a8990dc37dae079f168de8b845a4d09e216773f230c9 WatchSource:0}: Error finding container 92118dfd29a994ddc1d1a8990dc37dae079f168de8b845a4d09e216773f230c9: Status 404 returned error can't find the container with id 92118dfd29a994ddc1d1a8990dc37dae079f168de8b845a4d09e216773f230c9 Jul 09 16:20:46.416065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.416027 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-992v6" Jul 09 16:20:46.444546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.444504 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ph4pn" event={"ID":"fe1d8e86-0c1a-4266-bf9d-9946da6d184c","Type":"ContainerStarted","Data":"62d38de82e394a6494df9a59f1423272ba9671026e4a03c9ae3c1a79b43e9d08"} Jul 09 16:20:46.444546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.444548 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ph4pn" event={"ID":"fe1d8e86-0c1a-4266-bf9d-9946da6d184c","Type":"ContainerStarted","Data":"92118dfd29a994ddc1d1a8990dc37dae079f168de8b845a4d09e216773f230c9"} Jul 09 16:20:46.476294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:46.476243 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ph4pn" podStartSLOduration=1.476226912 podStartE2EDuration="1.476226912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:20:46.47497778 +0000 UTC m=+300.863460170" watchObservedRunningTime="2026-07-09 16:20:46.476226912 +0000 UTC m=+300.864709302" Jul 09 16:20:48.085375 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:48.085341 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:53.914545 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:53.914515 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:54.022361 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:54.022330 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:55.513731 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.513692 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg"] Jul 09 16:20:55.518909 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.518888 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.521980 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.521952 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:20:55.522838 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.522824 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:20:55.522937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.522849 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gz9xd\"" Jul 09 16:20:55.527806 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.527785 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg"] Jul 09 16:20:55.538940 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.538919 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.539031 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.538949 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcf5\" (UniqueName: \"kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.539031 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.538972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.639820 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.639785 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.639820 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.639820 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcf5\" (UniqueName: \"kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.640065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.639849 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.640155 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.640134 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.640212 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.640156 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.650106 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.650086 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcf5\" (UniqueName: \"kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.828619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.828531 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:55.963293 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:55.963265 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg"] Jul 09 16:20:55.965652 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:20:55.965606 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2078d403_42bd_4daa_9321_aa0290f89d71.slice/crio-3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af WatchSource:0}: Error finding container 3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af: Status 404 returned error can't find the container with id 3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af Jul 09 16:20:56.077076 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:56.077047 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:20:56.494183 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:56.494148 2571 generic.go:356] "Generic (PLEG): container finished" podID="2078d403-42bd-4daa-9321-aa0290f89d71" containerID="18f0125c5a64f9a8a8c363eaed0ec950ea4569dfe4da79c0dbc38cf1a346c730" exitCode=0 Jul 09 16:20:56.494382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:56.494204 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" event={"ID":"2078d403-42bd-4daa-9321-aa0290f89d71","Type":"ContainerDied","Data":"18f0125c5a64f9a8a8c363eaed0ec950ea4569dfe4da79c0dbc38cf1a346c730"} Jul 09 16:20:56.494382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:56.494270 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" event={"ID":"2078d403-42bd-4daa-9321-aa0290f89d71","Type":"ContainerStarted","Data":"3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af"} Jul 09 16:20:56.494734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:56.494718 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:20:57.500671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:57.500572 2571 generic.go:356] "Generic (PLEG): container finished" podID="2078d403-42bd-4daa-9321-aa0290f89d71" containerID="b264d69b038a6df7425798333d9184ce2cd144d232efe17cd747167a18d9a457" exitCode=0 Jul 09 16:20:57.500671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:57.500632 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" event={"ID":"2078d403-42bd-4daa-9321-aa0290f89d71","Type":"ContainerDied","Data":"b264d69b038a6df7425798333d9184ce2cd144d232efe17cd747167a18d9a457"} Jul 09 16:20:58.507521 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:58.507482 2571 generic.go:356] "Generic (PLEG): container finished" podID="2078d403-42bd-4daa-9321-aa0290f89d71" containerID="77afe066e962296ec39e080333200412788981bf909825d82fe63e0b5509b712" exitCode=0 Jul 09 16:20:58.507935 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:58.507572 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" event={"ID":"2078d403-42bd-4daa-9321-aa0290f89d71","Type":"ContainerDied","Data":"77afe066e962296ec39e080333200412788981bf909825d82fe63e0b5509b712"} Jul 09 16:20:59.642654 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.642629 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:20:59.678471 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.678443 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util\") pod \"2078d403-42bd-4daa-9321-aa0290f89d71\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " Jul 09 16:20:59.678649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.678498 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle\") pod \"2078d403-42bd-4daa-9321-aa0290f89d71\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " Jul 09 16:20:59.678649 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.678521 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxcf5\" (UniqueName: \"kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5\") pod \"2078d403-42bd-4daa-9321-aa0290f89d71\" (UID: \"2078d403-42bd-4daa-9321-aa0290f89d71\") " Jul 09 16:20:59.679236 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.679207 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle" (OuterVolumeSpecName: "bundle") pod "2078d403-42bd-4daa-9321-aa0290f89d71" (UID: "2078d403-42bd-4daa-9321-aa0290f89d71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:59.680765 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.680743 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5" (OuterVolumeSpecName: "kube-api-access-mxcf5") pod "2078d403-42bd-4daa-9321-aa0290f89d71" (UID: "2078d403-42bd-4daa-9321-aa0290f89d71"). InnerVolumeSpecName "kube-api-access-mxcf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:20:59.684478 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.684451 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util" (OuterVolumeSpecName: "util") pod "2078d403-42bd-4daa-9321-aa0290f89d71" (UID: "2078d403-42bd-4daa-9321-aa0290f89d71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:20:59.779378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.779287 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:59.779378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.779317 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxcf5\" (UniqueName: \"kubernetes.io/projected/2078d403-42bd-4daa-9321-aa0290f89d71-kube-api-access-mxcf5\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:20:59.779378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:20:59.779330 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2078d403-42bd-4daa-9321-aa0290f89d71-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:00.519685 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:00.519658 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" Jul 09 16:21:00.519846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:00.519653 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgv2pg" event={"ID":"2078d403-42bd-4daa-9321-aa0290f89d71","Type":"ContainerDied","Data":"3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af"} Jul 09 16:21:00.519846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:00.519795 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3790355eb6a19f71e1b5a8f645228ea1511a8b13f107126463c2a992fa35a2af" Jul 09 16:21:11.818484 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:11.818447 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:11.910112 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:11.910069 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:12.679522 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:12.679482 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.189153 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.189115 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.291068 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.291036 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.328446 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328411 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5"] Jul 09 16:21:13.328826 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328808 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="pull" Jul 09 16:21:13.328826 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328824 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="pull" Jul 09 16:21:13.328979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328841 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="extract" Jul 09 16:21:13.328979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328846 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="extract" Jul 09 16:21:13.328979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328862 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="util" Jul 09 16:21:13.328979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328870 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="util" Jul 09 16:21:13.328979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.328931 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2078d403-42bd-4daa-9321-aa0290f89d71" containerName="extract" Jul 09 16:21:13.334153 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.334129 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.338310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.338249 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 16:21:13.339846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.339804 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 16:21:13.339846 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.339806 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 16:21:13.340024 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.339920 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gdnnq\"" Jul 09 16:21:13.340024 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.339958 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 16:21:13.354589 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.354555 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5"] Jul 09 16:21:13.390806 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.390748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-webhook-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.391014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.390824 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.391014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.390868 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-manifests\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.391014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.390903 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-tmp\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.391014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.390926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9wlg\" (UniqueName: \"kubernetes.io/projected/94acfd89-9ad9-446d-9068-d7d4d3476940-kube-api-access-k9wlg\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.491601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.491493 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.491601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.491549 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-manifests\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.491601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.491583 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-tmp\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.491945 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.491607 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9wlg\" (UniqueName: \"kubernetes.io/projected/94acfd89-9ad9-446d-9068-d7d4d3476940-kube-api-access-k9wlg\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.491945 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.491706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-webhook-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.492073 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.492048 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-manifests\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.492274 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.492226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.494325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.494302 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.494407 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.494361 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94acfd89-9ad9-446d-9068-d7d4d3476940-webhook-cert\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.494720 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.494701 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94acfd89-9ad9-446d-9068-d7d4d3476940-tmp\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.502332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.502304 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9wlg\" (UniqueName: \"kubernetes.io/projected/94acfd89-9ad9-446d-9068-d7d4d3476940-kube-api-access-k9wlg\") pod \"opendatahub-operator-controller-manager-7df8c55954-rchc5\" (UID: \"94acfd89-9ad9-446d-9068-d7d4d3476940\") " pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.593640 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.593606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.645716 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.645679 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:13.754086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.754010 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:13.803089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.803069 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5"] Jul 09 16:21:13.805357 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:13.805333 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94acfd89_9ad9_446d_9068_d7d4d3476940.slice/crio-4008f9638e39e78be254491dd2efcde056b7bddc1baf589bfd6f078eb6908868 WatchSource:0}: Error finding container 4008f9638e39e78be254491dd2efcde056b7bddc1baf589bfd6f078eb6908868: Status 404 returned error can't find the container with id 4008f9638e39e78be254491dd2efcde056b7bddc1baf589bfd6f078eb6908868 Jul 09 16:21:13.869431 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:13.869394 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:14.049894 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:14.049761 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:14.581014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:14.580976 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" event={"ID":"94acfd89-9ad9-446d-9068-d7d4d3476940","Type":"ContainerStarted","Data":"4008f9638e39e78be254491dd2efcde056b7bddc1baf589bfd6f078eb6908868"} Jul 09 16:21:17.596967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:17.596929 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" event={"ID":"94acfd89-9ad9-446d-9068-d7d4d3476940","Type":"ContainerStarted","Data":"3dd562fc873bf982c239cb32eb40eec61e7285af7ac2cfffe9f45b153c403e5a"} Jul 09 16:21:17.942218 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:17.942185 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:18.043464 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:18.043419 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:18.604248 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:18.604218 2571 generic.go:356] "Generic (PLEG): container finished" podID="94acfd89-9ad9-446d-9068-d7d4d3476940" containerID="3dd562fc873bf982c239cb32eb40eec61e7285af7ac2cfffe9f45b153c403e5a" exitCode=0 Jul 09 16:21:18.604630 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:18.604261 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" event={"ID":"94acfd89-9ad9-446d-9068-d7d4d3476940","Type":"ContainerDied","Data":"3dd562fc873bf982c239cb32eb40eec61e7285af7ac2cfffe9f45b153c403e5a"} Jul 09 16:21:20.616091 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:20.616058 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" event={"ID":"94acfd89-9ad9-446d-9068-d7d4d3476940","Type":"ContainerStarted","Data":"eef73c02679eaa47443d0d2754fdb18c4c5618883a648033d71a700bbf1d3807"} Jul 09 16:21:20.616483 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:20.616193 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:20.641594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:20.641543 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" podStartSLOduration=2.300872497 podStartE2EDuration="7.641529476s" totalImagesPullingTime="4.327440627s" totalInitContainerRuntime="1.013216352s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:20.639090331 +0000 UTC m=+335.027572757" watchObservedRunningTime="2026-07-09 16:21:20.641529476 +0000 UTC m=+335.030011865" Jul 09 16:21:25.216175 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:25.216137 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:25.308860 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:25.308830 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:31.623965 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:31.623931 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7df8c55954-rchc5" Jul 09 16:21:33.327193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.327156 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:33.470536 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.470511 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:33.898420 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.898387 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:33.942290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.942260 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5"] Jul 09 16:21:33.950868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.950845 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:33.954978 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.954953 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-creds\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" type="*v1.Secret" Jul 09 16:21:33.958943 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.958919 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 09 16:21:33.959410 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.959392 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-tls\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" type="*v1.Secret" Jul 09 16:21:33.959576 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.959553 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kube-auth-proxy-59d9878b65-sf5p5\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="431d5864-0d6b-40db-8e05-f8317103463a" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:33.960015 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.959985 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kube-auth-proxy-dockercfg-67j44\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-67j44\"" type="*v1.Secret" Jul 09 16:21:33.960119 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:33.960059 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 09 16:21:33.975967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:33.975939 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5"] Jul 09 16:21:34.075276 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.075239 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/431d5864-0d6b-40db-8e05-f8317103463a-tls-certs\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.075456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.075345 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/431d5864-0d6b-40db-8e05-f8317103463a-tmp\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.075456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.075375 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lr7k\" (UniqueName: \"kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.176458 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.176424 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/431d5864-0d6b-40db-8e05-f8317103463a-tmp\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.176458 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.176457 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lr7k\" (UniqueName: \"kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.176662 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.176507 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/431d5864-0d6b-40db-8e05-f8317103463a-tls-certs\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.178932 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.178909 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/431d5864-0d6b-40db-8e05-f8317103463a-tmp\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:34.193346 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.193320 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6pmpr"] Jul 09 16:21:34.196738 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.196720 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.199477 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.199458 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 16:21:34.200406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.200386 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zzvd7\"" Jul 09 16:21:34.207449 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.207429 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6pmpr"] Jul 09 16:21:34.241922 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.241894 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:34.338668 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.338641 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:34.378516 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.378483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24c96593-3ed3-4722-a1d0-a8ef40b28671-cert\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.378516 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.378517 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mlzk\" (UniqueName: \"kubernetes.io/projected/24c96593-3ed3-4722-a1d0-a8ef40b28671-kube-api-access-7mlzk\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.439077 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.438988 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:34.479664 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.479631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24c96593-3ed3-4722-a1d0-a8ef40b28671-cert\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.479664 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.479663 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mlzk\" (UniqueName: \"kubernetes.io/projected/24c96593-3ed3-4722-a1d0-a8ef40b28671-kube-api-access-7mlzk\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.482211 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.482188 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/24c96593-3ed3-4722-a1d0-a8ef40b28671-cert\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.489056 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.489036 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mlzk\" (UniqueName: \"kubernetes.io/projected/24c96593-3ed3-4722-a1d0-a8ef40b28671-kube-api-access-7mlzk\") pod \"odh-model-controller-7998c67dc4-6pmpr\" (UID: \"24c96593-3ed3-4722-a1d0-a8ef40b28671\") " pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.507648 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.507622 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:34.657553 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.657530 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6pmpr"] Jul 09 16:21:34.658817 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:34.658792 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c96593_3ed3_4722_a1d0_a8ef40b28671.slice/crio-9cfacd4fb6021eed19c8581440b45cb9fcca5fe1aa3dff051098c1229e3b43bd WatchSource:0}: Error finding container 9cfacd4fb6021eed19c8581440b45cb9fcca5fe1aa3dff051098c1229e3b43bd: Status 404 returned error can't find the container with id 9cfacd4fb6021eed19c8581440b45cb9fcca5fe1aa3dff051098c1229e3b43bd Jul 09 16:21:34.679903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.679876 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" event={"ID":"24c96593-3ed3-4722-a1d0-a8ef40b28671","Type":"ContainerStarted","Data":"9cfacd4fb6021eed19c8581440b45cb9fcca5fe1aa3dff051098c1229e3b43bd"} Jul 09 16:21:34.844807 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.844706 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:34.886360 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:34.886332 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 16:21:35.119420 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.119346 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gm"] Jul 09 16:21:35.123834 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.123817 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.127732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.127713 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 16:21:35.141319 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.141298 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gm"] Jul 09 16:21:35.150897 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.150870 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:35.155014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.154978 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 16:21:35.159500 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.159480 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/431d5864-0d6b-40db-8e05-f8317103463a-tls-certs\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:35.186293 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:35.186262 2571 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jul 09 16:21:35.186414 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:35.186305 2571 projected.go:196] Error preparing data for projected volume kube-api-access-6lr7k for pod openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5: failed to sync configmap cache: timed out waiting for the condition Jul 09 16:21:35.186414 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:35.186382 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k podName:431d5864-0d6b-40db-8e05-f8317103463a nodeName:}" failed. No retries permitted until 2026-07-09 16:21:35.686356766 +0000 UTC m=+350.074839147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6lr7k" (UniqueName: "kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k") pod "kube-auth-proxy-59d9878b65-sf5p5" (UID: "431d5864-0d6b-40db-8e05-f8317103463a") : failed to sync configmap cache: timed out waiting for the condition Jul 09 16:21:35.187680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.187662 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 16:21:35.195312 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.195298 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 16:21:35.234501 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.234472 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-67j44\"" Jul 09 16:21:35.287764 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.287734 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8zqp\" (UniqueName: \"kubernetes.io/projected/91ab878c-645e-45cb-946d-616331b8418f-kube-api-access-s8zqp\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.287933 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.287849 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ab878c-645e-45cb-946d-616331b8418f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.389212 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.389121 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ab878c-645e-45cb-946d-616331b8418f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.389212 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.389191 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8zqp\" (UniqueName: \"kubernetes.io/projected/91ab878c-645e-45cb-946d-616331b8418f-kube-api-access-s8zqp\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.391684 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.391661 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91ab878c-645e-45cb-946d-616331b8418f-tls-certs\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.400742 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.400713 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:35.402588 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.402566 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8zqp\" (UniqueName: \"kubernetes.io/projected/91ab878c-645e-45cb-946d-616331b8418f-kube-api-access-s8zqp\") pod \"model-serving-api-54d89bd5fc-qb2gm\" (UID: \"91ab878c-645e-45cb-946d-616331b8418f\") " pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.428935 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.428904 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:35.432226 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.432211 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.434404 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.434386 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:35.435329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.435311 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 16:21:35.435450 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.435315 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 16:21:35.435450 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.435315 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 16:21:35.435643 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.435626 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xwwj4\"" Jul 09 16:21:35.435926 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.435912 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 16:21:35.448437 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.448384 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:35.499225 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.499032 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:35.591195 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591155 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591210 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591266 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591353 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591557 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqqxq\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.591652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.591625 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.603220 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.603172 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qb2gm"] Jul 09 16:21:35.605993 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:35.605955 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ab878c_645e_45cb_946d_616331b8418f.slice/crio-f1e114679f989e73135289cb92ba2045000f5d1711d80a5cad5aaaa82c6fffd8 WatchSource:0}: Error finding container f1e114679f989e73135289cb92ba2045000f5d1711d80a5cad5aaaa82c6fffd8: Status 404 returned error can't find the container with id f1e114679f989e73135289cb92ba2045000f5d1711d80a5cad5aaaa82c6fffd8 Jul 09 16:21:35.686590 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.686557 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" event={"ID":"91ab878c-645e-45cb-946d-616331b8418f","Type":"ContainerStarted","Data":"f1e114679f989e73135289cb92ba2045000f5d1711d80a5cad5aaaa82c6fffd8"} Jul 09 16:21:35.693013 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.692982 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693093 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqqxq\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693093 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693046 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lr7k\" (UniqueName: \"kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:35.693093 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693064 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693093 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693084 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693277 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693102 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693277 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693142 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693277 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693182 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.693952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.693902 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.695582 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.695562 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.696050 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.696028 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.696156 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.696114 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.696204 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.696158 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.696309 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.696291 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lr7k\" (UniqueName: \"kubernetes.io/projected/431d5864-0d6b-40db-8e05-f8317103463a-kube-api-access-6lr7k\") pod \"kube-auth-proxy-59d9878b65-sf5p5\" (UID: \"431d5864-0d6b-40db-8e05-f8317103463a\") " pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:35.702448 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.702424 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqqxq\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.702536 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.702428 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token\") pod \"istiod-openshift-gateway-7574459656-dp4qq\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.742487 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.742452 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:35.759669 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.759644 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" Jul 09 16:21:35.928867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.928835 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:35.930477 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:35.930376 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d5e129_2457_47bd_9bad_d0f0c4fad1f2.slice/crio-218c929a8b25985bdf88760e914febdbd1f523fa572ad47ca018bc2b86829af7 WatchSource:0}: Error finding container 218c929a8b25985bdf88760e914febdbd1f523fa572ad47ca018bc2b86829af7: Status 404 returned error can't find the container with id 218c929a8b25985bdf88760e914febdbd1f523fa572ad47ca018bc2b86829af7 Jul 09 16:21:35.951449 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:35.951418 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5"] Jul 09 16:21:35.954025 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:35.953996 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431d5864_0d6b_40db_8e05_f8317103463a.slice/crio-68dcb6990b567eaf5300d428c45df360c90904060d7dd53b0c83818d1f4e1faa WatchSource:0}: Error finding container 68dcb6990b567eaf5300d428c45df360c90904060d7dd53b0c83818d1f4e1faa: Status 404 returned error can't find the container with id 68dcb6990b567eaf5300d428c45df360c90904060d7dd53b0c83818d1f4e1faa Jul 09 16:21:36.450261 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:36.450230 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:36.694322 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:36.694286 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" event={"ID":"431d5864-0d6b-40db-8e05-f8317103463a","Type":"ContainerStarted","Data":"68dcb6990b567eaf5300d428c45df360c90904060d7dd53b0c83818d1f4e1faa"} Jul 09 16:21:36.696004 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:36.695961 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" event={"ID":"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2","Type":"ContainerStarted","Data":"218c929a8b25985bdf88760e914febdbd1f523fa572ad47ca018bc2b86829af7"} Jul 09 16:21:40.663329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:40.663297 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 16:21:40.663643 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:40.663364 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 09 16:21:41.498658 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.498622 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:41.631596 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.631565 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:41.729665 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.729622 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" event={"ID":"431d5864-0d6b-40db-8e05-f8317103463a","Type":"ContainerStarted","Data":"ff97027584777a8012bc4c982483a08e11d73f0ad6f47735078d5df57113eed3"} Jul 09 16:21:41.731215 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.731187 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" event={"ID":"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2","Type":"ContainerStarted","Data":"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f"} Jul 09 16:21:41.731350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.731314 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:41.732975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.732949 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" event={"ID":"91ab878c-645e-45cb-946d-616331b8418f","Type":"ContainerStarted","Data":"ca6378dddfe164240ea0751f889067c297f37fb5c9ee03c841a81ad8cc06a6f3"} Jul 09 16:21:41.733074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.732982 2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-dp4qq container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 16:21:41.733074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.733029 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 16:21:41.733193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.733107 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:41.734567 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.734545 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" event={"ID":"24c96593-3ed3-4722-a1d0-a8ef40b28671","Type":"ContainerStarted","Data":"de6a9a28948bb42e870d3c8a11cafc9b20e8bc7418887e04ea022da6b1341a1b"} Jul 09 16:21:41.734658 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.734602 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:41.755715 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.755626 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59d9878b65-sf5p5" podStartSLOduration=4.044874321 podStartE2EDuration="8.755607135s" totalImagesPullingTime="4.710732814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:41.751448878 +0000 UTC m=+356.139931269" watchObservedRunningTime="2026-07-09 16:21:41.755607135 +0000 UTC m=+356.144089526" Jul 09 16:21:41.778136 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.778083 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" podStartSLOduration=1.7793392890000002 podStartE2EDuration="7.778060792s" totalImagesPullingTime="5.998721503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:41.777790976 +0000 UTC m=+356.166273366" watchObservedRunningTime="2026-07-09 16:21:41.778060792 +0000 UTC m=+356.166543183" Jul 09 16:21:41.816233 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.816049 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" podStartSLOduration=1.8103297550000002 podStartE2EDuration="6.816027775s" totalImagesPullingTime="5.00569802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:41.812120115 +0000 UTC m=+356.200602505" watchObservedRunningTime="2026-07-09 16:21:41.816027775 +0000 UTC m=+356.204510164" Jul 09 16:21:41.841413 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.841379 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:41.850585 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:41.850533 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" podStartSLOduration=2.121575079 podStartE2EDuration="6.850518026s" totalImagesPullingTime="4.728942947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:41.848153702 +0000 UTC m=+356.236636103" watchObservedRunningTime="2026-07-09 16:21:41.850518026 +0000 UTC m=+356.239000413" Jul 09 16:21:42.014445 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.014365 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:42.250406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.250370 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:42.740105 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.740079 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:42.769802 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.769757 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv"] Jul 09 16:21:42.771959 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.771943 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.779199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779181 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 16:21:42.779290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779239 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sfm9g\"" Jul 09 16:21:42.779290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779259 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 16:21:42.779600 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779584 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 16:21:42.779651 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779638 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:21:42.779938 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.779922 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 16:21:42.792460 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.792437 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv"] Jul 09 16:21:42.854999 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.854966 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvn8\" (UniqueName: \"kubernetes.io/projected/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-kube-api-access-rcvn8\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.855207 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.855017 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-manager-config\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.855207 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.855178 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-metrics-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.855330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.855228 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.956670 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.956634 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.956899 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.956708 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvn8\" (UniqueName: \"kubernetes.io/projected/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-kube-api-access-rcvn8\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.956899 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.956765 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-manager-config\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.956899 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.956855 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-metrics-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.957593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.957519 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-manager-config\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.959342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.959311 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-metrics-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.959342 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.959333 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-cert\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:42.965994 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:42.965970 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvn8\" (UniqueName: \"kubernetes.io/projected/6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd-kube-api-access-rcvn8\") pod \"lws-controller-manager-5b747dc9cb-dmgzv\" (UID: \"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd\") " pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:43.081904 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:43.081811 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:43.220356 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:43.220326 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv"] Jul 09 16:21:43.222368 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:21:43.222336 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5294dd_35d1_4ef4_9a29_6fcf42c0f5dd.slice/crio-714095abe9281e067b2e055172ebb0c13ba713712ae5f5246e3183b0c83429a4 WatchSource:0}: Error finding container 714095abe9281e067b2e055172ebb0c13ba713712ae5f5246e3183b0c83429a4: Status 404 returned error can't find the container with id 714095abe9281e067b2e055172ebb0c13ba713712ae5f5246e3183b0c83429a4 Jul 09 16:21:43.745711 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:43.745673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" event={"ID":"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd","Type":"ContainerStarted","Data":"714095abe9281e067b2e055172ebb0c13ba713712ae5f5246e3183b0c83429a4"} Jul 09 16:21:45.464889 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:45.464856 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:45.616420 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:45.616378 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:45.757332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:45.757242 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" event={"ID":"6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd","Type":"ContainerStarted","Data":"0eed761f46b16310b0ef25b6e6e0a1429baab77389b7fba7e0ca36d4af4dc648"} Jul 09 16:21:45.757332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:45.757319 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:21:45.784869 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:45.784817 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" podStartSLOduration=2.271528133 podStartE2EDuration="3.78480159s" totalImagesPullingTime="1.513273457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:21:45.784062855 +0000 UTC m=+360.172545243" watchObservedRunningTime="2026-07-09 16:21:45.78480159 +0000 UTC m=+360.173283976" Jul 09 16:21:46.073506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.073418 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:46.219160 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.219131 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:46.424297 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.424259 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:46.424482 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.424443 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerName="discovery" containerID="cri-o://20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f" gracePeriod=30 Jul 09 16:21:46.677697 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.677635 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:46.763185 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.763149 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerID="20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f" exitCode=0 Jul 09 16:21:46.763352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.763193 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" Jul 09 16:21:46.763352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.763238 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" event={"ID":"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2","Type":"ContainerDied","Data":"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f"} Jul 09 16:21:46.763352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.763292 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq" event={"ID":"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2","Type":"ContainerDied","Data":"218c929a8b25985bdf88760e914febdbd1f523fa572ad47ca018bc2b86829af7"} Jul 09 16:21:46.763352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.763320 2571 scope.go:117] "RemoveContainer" containerID="20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f" Jul 09 16:21:46.771697 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.771680 2571 scope.go:117] "RemoveContainer" containerID="20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f" Jul 09 16:21:46.772007 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:21:46.771986 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f\": container with ID starting with 20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f not found: ID does not exist" containerID="20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f" Jul 09 16:21:46.772075 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.772015 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f"} err="failed to get container status \"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f\": rpc error: code = NotFound desc = could not find container \"20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f\": container with ID starting with 20678843577f5fe5d97e7f7ef25146fc91c8a2ce47c62e6fd657e831bf41fa3f not found: ID does not exist" Jul 09 16:21:46.793916 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.793885 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794023 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.793920 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794023 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.793950 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794124 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.794081 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794175 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.794161 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794227 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.794192 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqqxq\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794278 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.794224 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert\") pod \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\" (UID: \"e0d5e129-2457-47bd-9bad-d0f0c4fad1f2\") " Jul 09 16:21:46.794974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.794945 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:21:46.796788 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796738 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:21:46.796876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796759 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq" (OuterVolumeSpecName: "kube-api-access-nqqxq") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "kube-api-access-nqqxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:21:46.796876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796802 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:21:46.796995 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796884 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs" (OuterVolumeSpecName: "local-certs") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:21:46.796995 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796889 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts" (OuterVolumeSpecName: "cacerts") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:21:46.796995 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.796971 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" (UID: "e0d5e129-2457-47bd-9bad-d0f0c4fad1f2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:21:46.820261 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.820238 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:46.895252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895216 2571 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-token\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895248 2571 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-kubeconfig\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895257 2571 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-cacerts\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895265 2571 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-local-certs\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895274 2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-ca-configmap\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895284 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqqxq\" (UniqueName: \"kubernetes.io/projected/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-kube-api-access-nqqxq\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:46.895470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:46.895292 2571 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2-istio-csr-dns-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:21:47.002714 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:47.002608 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:47.090808 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:47.090757 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:47.095494 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:47.095470 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-dp4qq"] Jul 09 16:21:47.125533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:47.125504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:21:48.134795 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:48.134739 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" path="/var/lib/kubelet/pods/e0d5e129-2457-47bd-9bad-d0f0c4fad1f2/volumes" Jul 09 16:21:52.742223 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:52.742193 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6pmpr" Jul 09 16:21:52.744037 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:52.744017 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qb2gm" Jul 09 16:21:56.766329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:21:56.766298 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b747dc9cb-dmgzv" Jul 09 16:22:07.998521 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:07.998485 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:12.763440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:12.763407 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:12.822451 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:12.822397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:30.023445 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:30.023401 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:34.745997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:34.745957 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:34.846693 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:34.846655 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:34.930129 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:34.930095 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:22:50.479964 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.479925 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk"] Jul 09 16:22:50.480329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.480259 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerName="discovery" Jul 09 16:22:50.480329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.480269 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerName="discovery" Jul 09 16:22:50.480396 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.480354 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d5e129-2457-47bd-9bad-d0f0c4fad1f2" containerName="discovery" Jul 09 16:22:50.483072 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.483055 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.486555 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.486533 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:22:50.486831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.486815 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:22:50.487636 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.487617 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97vnj\"" Jul 09 16:22:50.492932 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.492911 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk"] Jul 09 16:22:50.560672 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.560634 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5p2\" (UniqueName: \"kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.560889 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.560746 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.560889 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.560765 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.661996 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.661949 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.661996 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.661995 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.662229 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.662045 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5p2\" (UniqueName: \"kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.662344 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.662326 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.662424 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.662404 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.671349 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.671322 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5p2\" (UniqueName: \"kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.793116 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.793025 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:50.932069 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:50.932043 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk"] Jul 09 16:22:50.934110 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:22:50.934080 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90f57182_eb02_45c3_9344_8b792de09a67.slice/crio-d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540 WatchSource:0}: Error finding container d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540: Status 404 returned error can't find the container with id d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540 Jul 09 16:22:51.063286 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.063209 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v"] Jul 09 16:22:51.065658 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.065641 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.074490 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.074463 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v"] Jul 09 16:22:51.077174 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.077144 2571 generic.go:356] "Generic (PLEG): container finished" podID="90f57182-eb02-45c3-9344-8b792de09a67" containerID="db9e607e3cc8c57a6b297aaf06102ce0f526736ce39a414377220dcc8285bd7b" exitCode=0 Jul 09 16:22:51.077294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.077205 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" event={"ID":"90f57182-eb02-45c3-9344-8b792de09a67","Type":"ContainerDied","Data":"db9e607e3cc8c57a6b297aaf06102ce0f526736ce39a414377220dcc8285bd7b"} Jul 09 16:22:51.077294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.077256 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" event={"ID":"90f57182-eb02-45c3-9344-8b792de09a67","Type":"ContainerStarted","Data":"d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540"} Jul 09 16:22:51.166672 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.166638 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.166880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.166736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4qjl\" (UniqueName: \"kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.166880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.166764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.267884 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.267846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4qjl\" (UniqueName: \"kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.268046 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.267940 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.268087 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.268051 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.268325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.268307 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.268365 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.268338 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.276293 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.276271 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4qjl\" (UniqueName: \"kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.399112 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.399017 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:51.529423 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.529396 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v"] Jul 09 16:22:51.531025 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:22:51.531003 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d8a8a72_af5d_4396_a254_1d3c50cb0733.slice/crio-be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670 WatchSource:0}: Error finding container be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670: Status 404 returned error can't find the container with id be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670 Jul 09 16:22:51.664224 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.664196 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl"] Jul 09 16:22:51.666468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.666453 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.675634 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.675613 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl"] Jul 09 16:22:51.772106 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.772073 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.772264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.772145 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg2hj\" (UniqueName: \"kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.772264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.772186 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.873559 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.873520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg2hj\" (UniqueName: \"kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.873761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.873584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.873761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.873604 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.874013 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.873996 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.874049 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.874030 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:51.882456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:51.882431 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg2hj\" (UniqueName: \"kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:52.001566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.001459 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:52.068129 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.068087 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw"] Jul 09 16:22:52.070979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.070953 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.081075 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.081044 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw"] Jul 09 16:22:52.087057 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.087022 2571 generic.go:356] "Generic (PLEG): container finished" podID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerID="98792a651cdb376faf5c166a0a282ca64d8f902b4ba85649bec247d82330d72d" exitCode=0 Jul 09 16:22:52.087222 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.087059 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" event={"ID":"3d8a8a72-af5d-4396-a254-1d3c50cb0733","Type":"ContainerDied","Data":"98792a651cdb376faf5c166a0a282ca64d8f902b4ba85649bec247d82330d72d"} Jul 09 16:22:52.087222 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.087141 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" event={"ID":"3d8a8a72-af5d-4396-a254-1d3c50cb0733","Type":"ContainerStarted","Data":"be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670"} Jul 09 16:22:52.156068 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.156046 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl"] Jul 09 16:22:52.166947 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:22:52.166919 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b52d32_fbf3_4546_b264_3ffe9bde14f0.slice/crio-2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d WatchSource:0}: Error finding container 2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d: Status 404 returned error can't find the container with id 2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d Jul 09 16:22:52.176553 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.176514 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.176668 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.176609 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wql9d\" (UniqueName: \"kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.176821 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.176757 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.277732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.277706 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.277839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.277763 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wql9d\" (UniqueName: \"kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.277895 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.277871 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.278095 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.278077 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.278240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.278224 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.287015 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.286993 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wql9d\" (UniqueName: \"kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.382863 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.382825 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:52.513739 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:52.513713 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw"] Jul 09 16:22:52.515826 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:22:52.515803 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc987cc_750c_468e_9066_5655471cecc7.slice/crio-4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc WatchSource:0}: Error finding container 4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc: Status 404 returned error can't find the container with id 4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc Jul 09 16:22:53.093564 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.093528 2571 generic.go:356] "Generic (PLEG): container finished" podID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerID="c3987dff76aaef247497731faf9ecc1d57f52656c1736aba5c217c77f600313b" exitCode=0 Jul 09 16:22:53.094017 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.093607 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" event={"ID":"3d8a8a72-af5d-4396-a254-1d3c50cb0733","Type":"ContainerDied","Data":"c3987dff76aaef247497731faf9ecc1d57f52656c1736aba5c217c77f600313b"} Jul 09 16:22:53.095323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.095301 2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc987cc-750c-468e-9066-5655471cecc7" containerID="992aa9fbca834af5cac4a6b7dcfd722cfab0ad937b4b505d8be9856b0698555a" exitCode=0 Jul 09 16:22:53.095396 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.095375 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" event={"ID":"9bc987cc-750c-468e-9066-5655471cecc7","Type":"ContainerDied","Data":"992aa9fbca834af5cac4a6b7dcfd722cfab0ad937b4b505d8be9856b0698555a"} Jul 09 16:22:53.095442 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.095416 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" event={"ID":"9bc987cc-750c-468e-9066-5655471cecc7","Type":"ContainerStarted","Data":"4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc"} Jul 09 16:22:53.097036 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.096997 2571 generic.go:356] "Generic (PLEG): container finished" podID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerID="99aa6f4e83fe30ffaca3c39edfe122f2e65de50772168276d23392d0a4584be1" exitCode=0 Jul 09 16:22:53.099183 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.097070 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" event={"ID":"21b52d32-fbf3-4546-b264-3ffe9bde14f0","Type":"ContainerDied","Data":"99aa6f4e83fe30ffaca3c39edfe122f2e65de50772168276d23392d0a4584be1"} Jul 09 16:22:53.099183 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.097343 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" event={"ID":"21b52d32-fbf3-4546-b264-3ffe9bde14f0","Type":"ContainerStarted","Data":"2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d"} Jul 09 16:22:53.106006 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.105975 2571 generic.go:356] "Generic (PLEG): container finished" podID="90f57182-eb02-45c3-9344-8b792de09a67" containerID="81549df6d05c6bf9ed53909c20e6c77c1475a68706df6c896ac707cb0d004c77" exitCode=0 Jul 09 16:22:53.106288 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:53.106019 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" event={"ID":"90f57182-eb02-45c3-9344-8b792de09a67","Type":"ContainerDied","Data":"81549df6d05c6bf9ed53909c20e6c77c1475a68706df6c896ac707cb0d004c77"} Jul 09 16:22:54.113360 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.113326 2571 generic.go:356] "Generic (PLEG): container finished" podID="90f57182-eb02-45c3-9344-8b792de09a67" containerID="adc70d191f61b73093313488a7f9632c8a54ac31d6bea37f6e9e71d65b90b57a" exitCode=0 Jul 09 16:22:54.113748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.113405 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" event={"ID":"90f57182-eb02-45c3-9344-8b792de09a67","Type":"ContainerDied","Data":"adc70d191f61b73093313488a7f9632c8a54ac31d6bea37f6e9e71d65b90b57a"} Jul 09 16:22:54.115409 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.115388 2571 generic.go:356] "Generic (PLEG): container finished" podID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerID="8660e7a02626a2c23b9b9ebe254466622b905c46cd0a8018106a200b6a13d744" exitCode=0 Jul 09 16:22:54.115504 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.115474 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" event={"ID":"3d8a8a72-af5d-4396-a254-1d3c50cb0733","Type":"ContainerDied","Data":"8660e7a02626a2c23b9b9ebe254466622b905c46cd0a8018106a200b6a13d744"} Jul 09 16:22:54.117105 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.117082 2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc987cc-750c-468e-9066-5655471cecc7" containerID="f3c25157f32323ba2d82b3777197a1be70e6f47d016417020de5e47997047f61" exitCode=0 Jul 09 16:22:54.117199 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:54.117142 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" event={"ID":"9bc987cc-750c-468e-9066-5655471cecc7","Type":"ContainerDied","Data":"f3c25157f32323ba2d82b3777197a1be70e6f47d016417020de5e47997047f61"} Jul 09 16:22:55.123867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.123835 2571 generic.go:356] "Generic (PLEG): container finished" podID="9bc987cc-750c-468e-9066-5655471cecc7" containerID="6e0a615cc78de5972fc2462ae46378d97941734ef3b11fc74549fc605d75c5c9" exitCode=0 Jul 09 16:22:55.124277 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.123924 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" event={"ID":"9bc987cc-750c-468e-9066-5655471cecc7","Type":"ContainerDied","Data":"6e0a615cc78de5972fc2462ae46378d97941734ef3b11fc74549fc605d75c5c9"} Jul 09 16:22:55.288998 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.288971 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:55.297803 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.297745 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:55.407493 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407388 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util\") pod \"90f57182-eb02-45c3-9344-8b792de09a67\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " Jul 09 16:22:55.407493 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407433 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util\") pod \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " Jul 09 16:22:55.407493 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407469 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle\") pod \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " Jul 09 16:22:55.407832 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407511 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4qjl\" (UniqueName: \"kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl\") pod \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\" (UID: \"3d8a8a72-af5d-4396-a254-1d3c50cb0733\") " Jul 09 16:22:55.407832 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407589 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j5p2\" (UniqueName: \"kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2\") pod \"90f57182-eb02-45c3-9344-8b792de09a67\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " Jul 09 16:22:55.407832 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.407611 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle\") pod \"90f57182-eb02-45c3-9344-8b792de09a67\" (UID: \"90f57182-eb02-45c3-9344-8b792de09a67\") " Jul 09 16:22:55.408251 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.408201 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle" (OuterVolumeSpecName: "bundle") pod "3d8a8a72-af5d-4396-a254-1d3c50cb0733" (UID: "3d8a8a72-af5d-4396-a254-1d3c50cb0733"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:55.408587 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.408562 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle" (OuterVolumeSpecName: "bundle") pod "90f57182-eb02-45c3-9344-8b792de09a67" (UID: "90f57182-eb02-45c3-9344-8b792de09a67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:55.410061 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.410032 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2" (OuterVolumeSpecName: "kube-api-access-6j5p2") pod "90f57182-eb02-45c3-9344-8b792de09a67" (UID: "90f57182-eb02-45c3-9344-8b792de09a67"). InnerVolumeSpecName "kube-api-access-6j5p2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:55.410156 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.410076 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl" (OuterVolumeSpecName: "kube-api-access-z4qjl") pod "3d8a8a72-af5d-4396-a254-1d3c50cb0733" (UID: "3d8a8a72-af5d-4396-a254-1d3c50cb0733"). InnerVolumeSpecName "kube-api-access-z4qjl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:55.413693 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.413675 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util" (OuterVolumeSpecName: "util") pod "3d8a8a72-af5d-4396-a254-1d3c50cb0733" (UID: "3d8a8a72-af5d-4396-a254-1d3c50cb0733"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:55.413934 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.413917 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util" (OuterVolumeSpecName: "util") pod "90f57182-eb02-45c3-9344-8b792de09a67" (UID: "90f57182-eb02-45c3-9344-8b792de09a67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:55.508476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508438 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j5p2\" (UniqueName: \"kubernetes.io/projected/90f57182-eb02-45c3-9344-8b792de09a67-kube-api-access-6j5p2\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:55.508476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508469 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:55.508476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508480 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90f57182-eb02-45c3-9344-8b792de09a67-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:55.508476 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508487 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:55.508743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508498 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d8a8a72-af5d-4396-a254-1d3c50cb0733-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:55.508743 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:55.508505 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4qjl\" (UniqueName: \"kubernetes.io/projected/3d8a8a72-af5d-4396-a254-1d3c50cb0733-kube-api-access-z4qjl\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:56.133484 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.133449 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" Jul 09 16:22:56.133978 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.133804 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" Jul 09 16:22:56.135562 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.135520 2571 generic.go:356] "Generic (PLEG): container finished" podID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerID="8544cd24d5972494a391de158c80bb94e9882660ec942fb6258589ce6d2a54f1" exitCode=0 Jul 09 16:22:56.136863 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.136829 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk" event={"ID":"90f57182-eb02-45c3-9344-8b792de09a67","Type":"ContainerDied","Data":"d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540"} Jul 09 16:22:56.136952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.136882 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d95fd7faa5ea30f58bb7df5ff4f9972e12b83c31a8dc36f2442e504c21c97540" Jul 09 16:22:56.136952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.136896 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v" event={"ID":"3d8a8a72-af5d-4396-a254-1d3c50cb0733","Type":"ContainerDied","Data":"be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670"} Jul 09 16:22:56.136952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.136920 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be42e66c1b03ddd58b9187be9211f801bbc7d4ce7477dc0d3bf42d573e3ba670" Jul 09 16:22:56.136952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.136931 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" event={"ID":"21b52d32-fbf3-4546-b264-3ffe9bde14f0","Type":"ContainerDied","Data":"8544cd24d5972494a391de158c80bb94e9882660ec942fb6258589ce6d2a54f1"} Jul 09 16:22:56.277550 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.277519 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:56.417175 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.417149 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util\") pod \"9bc987cc-750c-468e-9066-5655471cecc7\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " Jul 09 16:22:56.417357 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.417202 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wql9d\" (UniqueName: \"kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d\") pod \"9bc987cc-750c-468e-9066-5655471cecc7\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " Jul 09 16:22:56.417357 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.417227 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle\") pod \"9bc987cc-750c-468e-9066-5655471cecc7\" (UID: \"9bc987cc-750c-468e-9066-5655471cecc7\") " Jul 09 16:22:56.417755 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.417728 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle" (OuterVolumeSpecName: "bundle") pod "9bc987cc-750c-468e-9066-5655471cecc7" (UID: "9bc987cc-750c-468e-9066-5655471cecc7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:56.419453 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.419429 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d" (OuterVolumeSpecName: "kube-api-access-wql9d") pod "9bc987cc-750c-468e-9066-5655471cecc7" (UID: "9bc987cc-750c-468e-9066-5655471cecc7"). InnerVolumeSpecName "kube-api-access-wql9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:56.422651 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.422626 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util" (OuterVolumeSpecName: "util") pod "9bc987cc-750c-468e-9066-5655471cecc7" (UID: "9bc987cc-750c-468e-9066-5655471cecc7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:56.518632 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.518592 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wql9d\" (UniqueName: \"kubernetes.io/projected/9bc987cc-750c-468e-9066-5655471cecc7-kube-api-access-wql9d\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:56.518632 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.518623 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:56.518632 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:56.518632 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bc987cc-750c-468e-9066-5655471cecc7-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:57.142655 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:57.142628 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" Jul 09 16:22:57.143153 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:57.142623 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw" event={"ID":"9bc987cc-750c-468e-9066-5655471cecc7","Type":"ContainerDied","Data":"4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc"} Jul 09 16:22:57.143153 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:57.142743 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b0477cf4b4dc3a458fba75b0da45ad7a0dca139f9f96b27cbf478bcb50c8bcc" Jul 09 16:22:57.144681 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:57.144653 2571 generic.go:356] "Generic (PLEG): container finished" podID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerID="54a8b60019fa8be7680f1062dc8151b5c26e32d804bf9ab8e9223eca15b38389" exitCode=0 Jul 09 16:22:57.144817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:57.144686 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" event={"ID":"21b52d32-fbf3-4546-b264-3ffe9bde14f0","Type":"ContainerDied","Data":"54a8b60019fa8be7680f1062dc8151b5c26e32d804bf9ab8e9223eca15b38389"} Jul 09 16:22:58.279462 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.279439 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:22:58.433955 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.433922 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle\") pod \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " Jul 09 16:22:58.434132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.434004 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pg2hj\" (UniqueName: \"kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj\") pod \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " Jul 09 16:22:58.434132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.434050 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util\") pod \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\" (UID: \"21b52d32-fbf3-4546-b264-3ffe9bde14f0\") " Jul 09 16:22:58.434557 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.434518 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle" (OuterVolumeSpecName: "bundle") pod "21b52d32-fbf3-4546-b264-3ffe9bde14f0" (UID: "21b52d32-fbf3-4546-b264-3ffe9bde14f0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:58.436262 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.436241 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj" (OuterVolumeSpecName: "kube-api-access-pg2hj") pod "21b52d32-fbf3-4546-b264-3ffe9bde14f0" (UID: "21b52d32-fbf3-4546-b264-3ffe9bde14f0"). InnerVolumeSpecName "kube-api-access-pg2hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:22:58.440364 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.440338 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util" (OuterVolumeSpecName: "util") pod "21b52d32-fbf3-4546-b264-3ffe9bde14f0" (UID: "21b52d32-fbf3-4546-b264-3ffe9bde14f0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:22:58.534876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.534837 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-util\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:58.534876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.534870 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21b52d32-fbf3-4546-b264-3ffe9bde14f0-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:58.534876 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:58.534879 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pg2hj\" (UniqueName: \"kubernetes.io/projected/21b52d32-fbf3-4546-b264-3ffe9bde14f0-kube-api-access-pg2hj\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:22:59.156409 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:59.156376 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" event={"ID":"21b52d32-fbf3-4546-b264-3ffe9bde14f0","Type":"ContainerDied","Data":"2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d"} Jul 09 16:22:59.156574 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:59.156423 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ddde401a5bdb0112f122d40ca165ff68343db7d2947825269654216f228bd3d" Jul 09 16:22:59.156574 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:22:59.156425 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl" Jul 09 16:23:03.525368 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:03.525335 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:04.144569 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:04.144539 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:06.098275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:06.098187 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:06.198430 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:06.198397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:08.764288 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:08.764251 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:11.136561 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:11.136527 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:11.434178 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:11.434146 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:13.816059 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:13.816020 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:13.943057 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:13.943022 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:16.245304 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:16.245267 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:19.569343 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:19.569311 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:19.673919 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:19.673883 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:20.268489 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268454 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655465cb6b-jlmtt"] Jul 09 16:23:20.268803 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268789 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="util" Jul 09 16:23:20.268803 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268804 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="util" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268811 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="pull" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268816 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="pull" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268826 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="util" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268831 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="util" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268853 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268858 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268866 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268872 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268880 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268885 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268894 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="extract" Jul 09 16:23:20.268898 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268899 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="extract" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268905 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="util" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268910 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="util" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268916 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268920 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268930 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="util" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268934 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="util" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268941 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268945 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268954 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.268959 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="pull" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.269007 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="90f57182-eb02-45c3-9344-8b792de09a67" containerName="extract" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.269016 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bc987cc-750c-468e-9066-5655471cecc7" containerName="extract" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.269022 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d8a8a72-af5d-4396-a254-1d3c50cb0733" containerName="extract" Jul 09 16:23:20.269240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.269026 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="21b52d32-fbf3-4546-b264-3ffe9bde14f0" containerName="extract" Jul 09 16:23:20.271999 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.271984 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.289875 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.289847 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655465cb6b-jlmtt"] Jul 09 16:23:20.329526 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329496 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-service-ca\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329545 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-oauth-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329568 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cskx8\" (UniqueName: \"kubernetes.io/projected/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-kube-api-access-cskx8\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-trusted-ca-bundle\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329691 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-oauth-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329938 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329743 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.329938 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.329760 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.338038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.338012 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:20.430397 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-trusted-ca-bundle\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430397 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-oauth-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430425 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430439 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430571 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-service-ca\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430680 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430651 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-oauth-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.430944 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.430686 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cskx8\" (UniqueName: \"kubernetes.io/projected/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-kube-api-access-cskx8\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.431215 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.431189 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.431340 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.431286 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-service-ca\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.431436 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.431411 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-oauth-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.431503 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.431490 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-trusted-ca-bundle\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.433440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.433422 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-serving-cert\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.433572 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.433553 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-console-oauth-config\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.442571 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.442548 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cskx8\" (UniqueName: \"kubernetes.io/projected/244eacb5-250b-4ca7-b8f1-0403eb8b34cd-kube-api-access-cskx8\") pod \"console-655465cb6b-jlmtt\" (UID: \"244eacb5-250b-4ca7-b8f1-0403eb8b34cd\") " pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.443465 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.443446 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:20.538985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.538898 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:20.581940 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.581902 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:20.729975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:20.729945 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655465cb6b-jlmtt"] Jul 09 16:23:20.731385 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:23:20.731359 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244eacb5_250b_4ca7_b8f1_0403eb8b34cd.slice/crio-9022a5d193cdb18d59f6d7f2706e05f2c7b304563fe62d2c588b053030877f9f WatchSource:0}: Error finding container 9022a5d193cdb18d59f6d7f2706e05f2c7b304563fe62d2c588b053030877f9f: Status 404 returned error can't find the container with id 9022a5d193cdb18d59f6d7f2706e05f2c7b304563fe62d2c588b053030877f9f Jul 09 16:23:21.069088 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:21.068969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:21.266099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:21.266065 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655465cb6b-jlmtt" event={"ID":"244eacb5-250b-4ca7-b8f1-0403eb8b34cd","Type":"ContainerStarted","Data":"d03ce9569e25ef789d89a749fabde4c866135e8963699377c1b0b62864cd4de7"} Jul 09 16:23:21.266269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:21.266142 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655465cb6b-jlmtt" event={"ID":"244eacb5-250b-4ca7-b8f1-0403eb8b34cd","Type":"ContainerStarted","Data":"9022a5d193cdb18d59f6d7f2706e05f2c7b304563fe62d2c588b053030877f9f"} Jul 09 16:23:21.293132 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:21.293084 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655465cb6b-jlmtt" podStartSLOduration=1.2930696830000001 podStartE2EDuration="1.293069683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:23:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:23:21.291195781 +0000 UTC m=+455.679678170" watchObservedRunningTime="2026-07-09 16:23:21.293069683 +0000 UTC m=+455.681552072" Jul 09 16:23:22.541671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:22.541639 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:22.644562 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:22.644525 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:26.862805 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:26.862751 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:27.020749 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.020712 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-86j68"] Jul 09 16:23:27.024225 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.024208 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.025738 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.025705 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:27.026949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.026928 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:23:27.026949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.026944 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 16:23:27.027121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.026931 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:23:27.027121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.027071 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 16:23:27.031323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.031159 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-97vnj\"" Jul 09 16:23:27.039310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.039280 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-86j68"] Jul 09 16:23:27.088812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.088747 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.089002 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.088847 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7dk\" (UniqueName: \"kubernetes.io/projected/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-kube-api-access-sg7dk\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.089002 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.088935 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.189976 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.189941 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7dk\" (UniqueName: \"kubernetes.io/projected/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-kube-api-access-sg7dk\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.190142 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.190004 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.190142 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.190029 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.190142 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:23:27.190108 2571 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 16:23:27.190259 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:23:27.190169 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert podName:9e2a5fc2-1dc5-49c6-b76f-74a1640a7785 nodeName:}" failed. No retries permitted until 2026-07-09 16:23:27.690152631 +0000 UTC m=+462.078635001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-86j68" (UID: "9e2a5fc2-1dc5-49c6-b76f-74a1640a7785") : secret "plugin-serving-cert" not found Jul 09 16:23:27.190583 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.190563 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.213594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.213559 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7dk\" (UniqueName: \"kubernetes.io/projected/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-kube-api-access-sg7dk\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.330269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.330235 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:27.693735 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.693702 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.696187 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.696164 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e2a5fc2-1dc5-49c6-b76f-74a1640a7785-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-86j68\" (UID: \"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:27.933843 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:27.933805 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" Jul 09 16:23:28.068735 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:28.068700 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-86j68"] Jul 09 16:23:28.070161 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:23:28.070125 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e2a5fc2_1dc5_49c6_b76f_74a1640a7785.slice/crio-96223539a7b0d8c7ebe41a55f1e71c57cace8b197529e56d90ee7e0061caeb0a WatchSource:0}: Error finding container 96223539a7b0d8c7ebe41a55f1e71c57cace8b197529e56d90ee7e0061caeb0a: Status 404 returned error can't find the container with id 96223539a7b0d8c7ebe41a55f1e71c57cace8b197529e56d90ee7e0061caeb0a Jul 09 16:23:28.302863 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:28.302759 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" event={"ID":"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785","Type":"ContainerStarted","Data":"96223539a7b0d8c7ebe41a55f1e71c57cace8b197529e56d90ee7e0061caeb0a"} Jul 09 16:23:30.116296 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:30.116246 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:30.217673 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:30.217637 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:30.582339 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:30.582300 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:30.582528 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:30.582370 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:30.588040 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:30.588010 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:31.324628 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:31.324602 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655465cb6b-jlmtt" Jul 09 16:23:31.374111 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:31.374078 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:23:31.490470 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:31.490432 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:32.340243 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:32.340208 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:32.568254 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:32.568216 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:32.669756 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:32.669726 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:34.814714 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:34.814680 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:34.914949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:34.914907 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:37.972757 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:37.972721 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:38.082151 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:38.082119 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:38.363363 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:38.363313 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:38.464977 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:38.464946 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:40.937796 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:40.937735 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:41.039956 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:41.039924 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:46.144508 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:46.144476 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:46.251248 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:46.251207 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:49.772663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:49.772618 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:49.864466 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:49.864400 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:23:52.446440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:52.446395 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" event={"ID":"9e2a5fc2-1dc5-49c6-b76f-74a1640a7785","Type":"ContainerStarted","Data":"fa9e87022f4403d9bceaa79684565cb391ffb840f0c853a4c3fb529b62ed018e"} Jul 09 16:23:52.466537 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:52.466477 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-86j68" podStartSLOduration=3.105575827 podStartE2EDuration="26.466460779s" totalImagesPullingTime="23.360884952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:23:52.465367818 +0000 UTC m=+486.853850209" watchObservedRunningTime="2026-07-09 16:23:52.466460779 +0000 UTC m=+486.854943168" Jul 09 16:23:56.395294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.395235 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-765556458b-zzhp8" podUID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" containerName="console" containerID="cri-o://972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f" gracePeriod=15 Jul 09 16:23:56.639750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.639721 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:23:56.668074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668047 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668102 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668124 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668146 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668281 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668392 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668350 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668392 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668385 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn6dk\" (UniqueName: \"kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk\") pod \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\" (UID: \"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669\") " Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668546 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca" (OuterVolumeSpecName: "service-ca") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668637 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config" (OuterVolumeSpecName: "console-config") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668664 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668737 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668751 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.668855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668765 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.669143 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.668869 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:23:56.670677 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.670657 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk" (OuterVolumeSpecName: "kube-api-access-wn6dk") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "kube-api-access-wn6dk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:23:56.670965 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.670948 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:23:56.671032 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.670970 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" (UID: "7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:23:56.770099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.770061 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.770099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.770090 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn6dk\" (UniqueName: \"kubernetes.io/projected/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-kube-api-access-wn6dk\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.770099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.770100 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:56.770099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:56.770108 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:23:57.471920 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.471879 2571 generic.go:356] "Generic (PLEG): container finished" podID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" containerID="972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f" exitCode=0 Jul 09 16:23:57.471920 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.471922 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765556458b-zzhp8" Jul 09 16:23:57.472352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.471970 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765556458b-zzhp8" event={"ID":"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669","Type":"ContainerDied","Data":"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f"} Jul 09 16:23:57.472352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.472029 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765556458b-zzhp8" event={"ID":"7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669","Type":"ContainerDied","Data":"3d1fa212bea24fe65d3bfb2c7b74dc002859bbfdab27f80c2bad9fd032d90efa"} Jul 09 16:23:57.472352 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.472051 2571 scope.go:117] "RemoveContainer" containerID="972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f" Jul 09 16:23:57.482009 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.481992 2571 scope.go:117] "RemoveContainer" containerID="972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f" Jul 09 16:23:57.482271 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:23:57.482253 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f\": container with ID starting with 972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f not found: ID does not exist" containerID="972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f" Jul 09 16:23:57.482323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.482281 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f"} err="failed to get container status \"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f\": rpc error: code = NotFound desc = could not find container \"972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f\": container with ID starting with 972917dfda12e0b123f33020c782e78de0d9798f25687681e159665cd74f370f not found: ID does not exist" Jul 09 16:23:57.494358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.494324 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:23:57.499934 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:57.499911 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-765556458b-zzhp8"] Jul 09 16:23:58.134750 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:23:58.134716 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" path="/var/lib/kubelet/pods/7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669/volumes" Jul 09 16:24:10.406893 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:10.406855 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:10.575604 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:10.575572 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:12.128188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.128149 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:12.236378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.236325 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:12.297837 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.297793 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:12.552576 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.552544 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:24:12.552940 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.552927 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" containerName="console" Jul 09 16:24:12.552991 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.552941 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" containerName="console" Jul 09 16:24:12.553026 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.552996 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd82a4e-8c5f-44f2-afa6-3cd71eb8f669" containerName="console" Jul 09 16:24:12.669414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.669378 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:24:12.669414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.669419 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:24:12.669648 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.669500 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.674143 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.674122 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 16:24:12.713903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.713865 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-config-file\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.713903 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.713906 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt2g8\" (UniqueName: \"kubernetes.io/projected/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-kube-api-access-vt2g8\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.814388 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.814301 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt2g8\" (UniqueName: \"kubernetes.io/projected/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-kube-api-access-vt2g8\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.814542 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.814434 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-config-file\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.815080 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.815061 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-config-file\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.822819 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.822802 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt2g8\" (UniqueName: \"kubernetes.io/projected/f04b8bc1-7bc7-4c81-8a65-fdea3f025841-kube-api-access-vt2g8\") pod \"limitador-limitador-54d6d988d5-gq87v\" (UID: \"f04b8bc1-7bc7-4c81-8a65-fdea3f025841\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.976471 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.976436 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:12.979731 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.979707 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:12.998629 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.998601 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:12.998816 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:12.998708 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:13.001156 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.001132 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2jwtt\"" Jul 09 16:24:13.016077 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.016028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:13.082533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.082456 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:13.117338 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.117301 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbvw\" (UniqueName: \"kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw\") pod \"authorino-58cd955675-rnclt\" (UID: \"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841\") " pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:13.143119 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.143090 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:24:13.143815 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:24:13.143785 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04b8bc1_7bc7_4c81_8a65_fdea3f025841.slice/crio-73bad346b5fb04d741ee5cb16da88ef4c059c3270434606abad774efd675466e WatchSource:0}: Error finding container 73bad346b5fb04d741ee5cb16da88ef4c059c3270434606abad774efd675466e: Status 404 returned error can't find the container with id 73bad346b5fb04d741ee5cb16da88ef4c059c3270434606abad774efd675466e Jul 09 16:24:13.218821 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.218790 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbvw\" (UniqueName: \"kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw\") pod \"authorino-58cd955675-rnclt\" (UID: \"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841\") " pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:13.227026 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.226996 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbvw\" (UniqueName: \"kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw\") pod \"authorino-58cd955675-rnclt\" (UID: \"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841\") " pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:13.308247 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.308211 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:13.460830 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.460802 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:13.462796 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:24:13.462757 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c2a879c_e1c5_4e2c_b8b6_d83c3672a841.slice/crio-ff4916c084f3ee20dc86fc4896ed88450fbe73b77bfbf8d858e2260505defe1b WatchSource:0}: Error finding container ff4916c084f3ee20dc86fc4896ed88450fbe73b77bfbf8d858e2260505defe1b: Status 404 returned error can't find the container with id ff4916c084f3ee20dc86fc4896ed88450fbe73b77bfbf8d858e2260505defe1b Jul 09 16:24:13.554441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.554402 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rnclt" event={"ID":"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841","Type":"ContainerStarted","Data":"ff4916c084f3ee20dc86fc4896ed88450fbe73b77bfbf8d858e2260505defe1b"} Jul 09 16:24:13.555642 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:13.555614 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" event={"ID":"f04b8bc1-7bc7-4c81-8a65-fdea3f025841","Type":"ContainerStarted","Data":"73bad346b5fb04d741ee5cb16da88ef4c059c3270434606abad774efd675466e"} Jul 09 16:24:18.591909 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.591865 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rnclt" event={"ID":"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841","Type":"ContainerStarted","Data":"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889"} Jul 09 16:24:18.593457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.593431 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" event={"ID":"f04b8bc1-7bc7-4c81-8a65-fdea3f025841","Type":"ContainerStarted","Data":"61ea51988eb9fbbf6bd3dbe1722753c31cc392c293afd8ab63de78fbd58dfb61"} Jul 09 16:24:18.593563 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.593517 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:18.607397 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.607306 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rnclt" podStartSLOduration=1.704851119 podStartE2EDuration="6.607291713s" totalImagesPullingTime="4.902440594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:24:18.606365382 +0000 UTC m=+512.994847772" watchObservedRunningTime="2026-07-09 16:24:18.607291713 +0000 UTC m=+512.995774101" Jul 09 16:24:18.626288 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.626228 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" podStartSLOduration=1.419210951 podStartE2EDuration="6.626207475s" totalImagesPullingTime="5.206996524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:24:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:24:18.625985129 +0000 UTC m=+513.014467520" watchObservedRunningTime="2026-07-09 16:24:18.626207475 +0000 UTC m=+513.014689868" Jul 09 16:24:18.865587 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:18.865503 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:20.603921 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:20.603858 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rnclt" podUID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" containerName="authorino" containerID="cri-o://3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889" gracePeriod=30 Jul 09 16:24:20.851695 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:20.851670 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:20.996301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:20.996272 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbbvw\" (UniqueName: \"kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw\") pod \"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841\" (UID: \"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841\") " Jul 09 16:24:20.998534 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:20.998504 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw" (OuterVolumeSpecName: "kube-api-access-pbbvw") pod "7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" (UID: "7c2a879c-e1c5-4e2c-b8b6-d83c3672a841"). InnerVolumeSpecName "kube-api-access-pbbvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:24:21.097491 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.097449 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbbvw\" (UniqueName: \"kubernetes.io/projected/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841-kube-api-access-pbbvw\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:24:21.609666 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.609627 2571 generic.go:356] "Generic (PLEG): container finished" podID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" containerID="3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889" exitCode=0 Jul 09 16:24:21.610190 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.609675 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rnclt" Jul 09 16:24:21.610190 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.609719 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rnclt" event={"ID":"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841","Type":"ContainerDied","Data":"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889"} Jul 09 16:24:21.610190 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.609790 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rnclt" event={"ID":"7c2a879c-e1c5-4e2c-b8b6-d83c3672a841","Type":"ContainerDied","Data":"ff4916c084f3ee20dc86fc4896ed88450fbe73b77bfbf8d858e2260505defe1b"} Jul 09 16:24:21.610190 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.609818 2571 scope.go:117] "RemoveContainer" containerID="3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889" Jul 09 16:24:21.619221 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.619203 2571 scope.go:117] "RemoveContainer" containerID="3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889" Jul 09 16:24:21.619505 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:24:21.619488 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889\": container with ID starting with 3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889 not found: ID does not exist" containerID="3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889" Jul 09 16:24:21.619555 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.619515 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889"} err="failed to get container status \"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889\": rpc error: code = NotFound desc = could not find container \"3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889\": container with ID starting with 3138358362dc9360bec726ea50e670b6366104f139daad3619fee5d245b83889 not found: ID does not exist" Jul 09 16:24:21.632007 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.631980 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:21.635597 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:21.635575 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rnclt"] Jul 09 16:24:22.135809 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:22.135755 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" path="/var/lib/kubelet/pods/7c2a879c-e1c5-4e2c-b8b6-d83c3672a841/volumes" Jul 09 16:24:29.601263 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:29.601234 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gq87v" Jul 09 16:24:33.521249 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:33.521214 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:33.620469 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:33.620427 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:34.108759 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:34.108727 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:48.313621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:48.313580 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:48.412429 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:48.412370 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:54.649464 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:54.649427 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:54.765516 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:54.765480 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:54.873601 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:54.873569 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:55.017942 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:55.017906 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:58.637058 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:58.637024 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:24:58.737171 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:24:58.737131 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:28.793044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:28.792996 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:29.230581 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:29.230545 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:29.431608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:29.431567 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:29.825112 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:29.825082 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:29.930684 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:29.930629 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:30.126869 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:30.126788 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:25:39.902589 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:39.902546 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:42.470659 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:42.470617 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:46.011877 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:46.011853 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:25:46.015015 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:46.014993 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:25:49.722698 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:49.722667 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:25:50.291033 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:25:50.291001 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:26:02.524650 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:02.524618 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:03.204518 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:03.204481 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:26:09.212900 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.212818 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w"] Jul 09 16:26:09.213263 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.213209 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" containerName="authorino" Jul 09 16:26:09.213263 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.213221 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" containerName="authorino" Jul 09 16:26:09.213335 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.213293 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c2a879c-e1c5-4e2c-b8b6-d83c3672a841" containerName="authorino" Jul 09 16:26:09.215228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.215212 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.219802 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.219759 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 16:26:09.220378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.220358 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 16:26:09.220552 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.220387 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 16:26:09.220962 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.220947 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8g5kt\"" Jul 09 16:26:09.241314 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.241274 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w"] Jul 09 16:26:09.336795 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.336736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.336982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.336807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.336982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.336885 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b20be8-5350-4058-9631-e52062b48d9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.336982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.336919 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.336982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.336952 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksd9f\" (UniqueName: \"kubernetes.io/projected/e4b20be8-5350-4058-9631-e52062b48d9e-kube-api-access-ksd9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.337125 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.337019 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438187 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksd9f\" (UniqueName: \"kubernetes.io/projected/e4b20be8-5350-4058-9631-e52062b48d9e-kube-api-access-ksd9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438243 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438411 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438441 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438500 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b20be8-5350-4058-9631-e52062b48d9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438548 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438835 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438805 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438906 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438860 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.438906 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.438881 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.440633 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.440616 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b20be8-5350-4058-9631-e52062b48d9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.441048 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.441028 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b20be8-5350-4058-9631-e52062b48d9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.448023 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.448000 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksd9f\" (UniqueName: \"kubernetes.io/projected/e4b20be8-5350-4058-9631-e52062b48d9e-kube-api-access-ksd9f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tcd2w\" (UID: \"e4b20be8-5350-4058-9631-e52062b48d9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.525140 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.525035 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:09.660350 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.660322 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w"] Jul 09 16:26:09.661877 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:26:09.661833 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b20be8_5350_4058_9631_e52062b48d9e.slice/crio-a505ccbb6c5d2c8fb85d00547096aac3dd55c2f6274c6cc4a86d0774bc7544d0 WatchSource:0}: Error finding container a505ccbb6c5d2c8fb85d00547096aac3dd55c2f6274c6cc4a86d0774bc7544d0: Status 404 returned error can't find the container with id a505ccbb6c5d2c8fb85d00547096aac3dd55c2f6274c6cc4a86d0774bc7544d0 Jul 09 16:26:09.663127 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.663112 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:26:09.751045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.751013 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:09.848008 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:09.847899 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:10.167844 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:10.167804 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" event={"ID":"e4b20be8-5350-4058-9631-e52062b48d9e","Type":"ContainerStarted","Data":"a505ccbb6c5d2c8fb85d00547096aac3dd55c2f6274c6cc4a86d0774bc7544d0"} Jul 09 16:26:10.490637 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:10.490549 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:26:11.174415 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:11.174382 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" event={"ID":"e4b20be8-5350-4058-9631-e52062b48d9e","Type":"ContainerStarted","Data":"3fcad969ebadb95d07ec719f857978f172fbe3bac5c7472f2544bae280a43364"} Jul 09 16:26:11.196977 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:11.196923 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" podStartSLOduration=1.210011266 podStartE2EDuration="2.196907496s" totalImagesPullingTime="986.89623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:26:11.196282852 +0000 UTC m=+625.584765242" watchObservedRunningTime="2026-07-09 16:26:11.196907496 +0000 UTC m=+625.585389885" Jul 09 16:26:19.525408 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:19.525358 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:19.525837 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:19.525434 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:19.537728 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:19.537699 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:20.231490 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:20.231460 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tcd2w" Jul 09 16:26:28.879690 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:28.879657 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:30.298399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:30.298354 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:26:41.837045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:41.837006 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:43.897807 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:43.897752 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:26:49.145427 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:49.145391 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:26:51.588452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:26:51.588418 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:27:18.449099 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:18.449067 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:24.176975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:24.176945 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:29.822873 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.822836 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574fd8f489-xst66"] Jul 09 16:27:29.826217 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.826198 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:29.829813 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.829792 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 16:27:29.829813 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.829810 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2jwtt\"" Jul 09 16:27:29.834274 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.834251 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574fd8f489-xst66"] Jul 09 16:27:29.905227 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.905176 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c75394c8-2257-400d-8dca-f051467486e9-tls-cert\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:29.905443 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:29.905262 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4ws\" (UniqueName: \"kubernetes.io/projected/c75394c8-2257-400d-8dca-f051467486e9-kube-api-access-9w4ws\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.006503 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.006444 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c75394c8-2257-400d-8dca-f051467486e9-tls-cert\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.006718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.006574 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4ws\" (UniqueName: \"kubernetes.io/projected/c75394c8-2257-400d-8dca-f051467486e9-kube-api-access-9w4ws\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.009125 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.009105 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c75394c8-2257-400d-8dca-f051467486e9-tls-cert\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.017650 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.017624 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4ws\" (UniqueName: \"kubernetes.io/projected/c75394c8-2257-400d-8dca-f051467486e9-kube-api-access-9w4ws\") pod \"authorino-574fd8f489-xst66\" (UID: \"c75394c8-2257-400d-8dca-f051467486e9\") " pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.136067 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.135986 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574fd8f489-xst66" Jul 09 16:27:30.245845 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.245800 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:30.285340 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.285316 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574fd8f489-xst66"] Jul 09 16:27:30.286830 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:27:30.286798 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75394c8_2257_400d_8dca_f051467486e9.slice/crio-77d09dc336256eefe9834b30155e481e56c8fb6eccb1044b96ea5e1921893856 WatchSource:0}: Error finding container 77d09dc336256eefe9834b30155e481e56c8fb6eccb1044b96ea5e1921893856: Status 404 returned error can't find the container with id 77d09dc336256eefe9834b30155e481e56c8fb6eccb1044b96ea5e1921893856 Jul 09 16:27:30.350311 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.350258 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:30.568886 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.568851 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574fd8f489-xst66" event={"ID":"c75394c8-2257-400d-8dca-f051467486e9","Type":"ContainerStarted","Data":"77d09dc336256eefe9834b30155e481e56c8fb6eccb1044b96ea5e1921893856"} Jul 09 16:27:30.990602 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:30.990559 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:31.091172 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:31.091149 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:31.441500 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:31.441466 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:31.546678 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:31.546639 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:27:31.575421 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:31.575381 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574fd8f489-xst66" event={"ID":"c75394c8-2257-400d-8dca-f051467486e9","Type":"ContainerStarted","Data":"f126e6e3e7b0a40b1821c1fc1a4fd57fbd3638f16b594ec92ad1e74614ae0618"} Jul 09 16:27:31.594434 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:27:31.594375 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574fd8f489-xst66" podStartSLOduration=1.792556584 podStartE2EDuration="2.594357563s" totalImagesPullingTime="801.800979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:27:31.592001642 +0000 UTC m=+705.980484026" watchObservedRunningTime="2026-07-09 16:27:31.594357563 +0000 UTC m=+705.982839952" Jul 09 16:28:01.392048 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:01.392012 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:28:10.690607 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:10.690563 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:28:22.589618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:22.589576 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:28:30.585325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:30.585279 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:28:38.560351 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:38.560306 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:28:38.702191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:38.702144 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:28:41.985449 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:41.985413 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:28:43.875785 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:43.875747 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:28:45.897203 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:45.897153 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:28:57.087166 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:57.087129 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:28:57.150747 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:28:57.150700 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:08.195187 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:08.195093 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:29:23.293306 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:23.293273 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:29:27.812485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:27.812451 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:27.906657 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:27.906595 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:28.124375 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:28.124268 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:33.927332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:33.927285 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:33.991546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:33.991499 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:34.080882 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:34.080841 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:34.181429 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:34.181339 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:34.502389 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:34.502266 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:40.127638 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:40.127593 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:40.197038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:40.197004 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:29:57.293851 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:29:57.293808 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:06.886786 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:06.886728 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:17.684362 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:17.684324 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:23.899949 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:23.899912 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:33.112247 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:33.112213 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:42.989311 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:42.989275 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:30:46.048684 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:46.048659 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:30:46.052121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:46.052099 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:30:54.690246 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:30:54.690208 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:31:04.880111 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:31:04.880078 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:31:26.982398 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:31:26.982360 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:31:39.189038 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:31:39.189002 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:02.619182 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:02.619139 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:12.110791 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:12.110689 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:28.292783 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:28.292744 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:37.896831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:37.896789 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:39.994377 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:39.994337 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:32:47.786219 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:47.786177 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:32:57.590587 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:32:57.590544 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:33:06.093784 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:33:06.093726 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:34:57.892210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:34:57.892176 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:34:57.980943 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:34:57.980911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:35:00.485985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:00.485946 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:35:09.887751 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:09.887658 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:35:23.098666 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:23.098629 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:35:31.666784 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:31.666749 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:35:31.723844 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:31.723759 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:35:34.313041 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:34.313008 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:35:46.082530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:46.082499 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:35:46.084121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:46.084089 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:35:46.089053 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:46.089035 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:35:55.987228 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:35:55.987187 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:36:05.287506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:36:05.287462 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:36:14.987859 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:36:14.987825 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:36:27.314807 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:36:27.314753 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:36:36.184734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:36:36.184649 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:36:47.298015 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:36:47.297984 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:37:11.583788 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:37:11.583744 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:37:18.912961 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:37:18.912919 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:37:29.381588 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:37:29.381557 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:37:39.109418 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:37:39.109370 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:37:48.796207 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:37:48.796175 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:00.898323 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:00.898285 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:12.190251 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:12.190172 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:21.491082 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:21.491045 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:32.092618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:32.092589 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:41.594089 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:41.594056 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:38:51.189424 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:38:51.189383 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:04.484119 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:04.484079 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:13.792000 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:13.791966 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:23.293661 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:23.293626 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:32.972544 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:32.972512 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:39:34.585503 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:34.585460 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:46.984330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:46.984250 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:39:55.793843 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:39:55.793807 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:07.084888 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:07.084857 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:19.079671 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:19.079636 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:31.786842 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:31.786802 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:36.095960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:36.095924 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:40:40.587675 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:40.587640 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:44.464019 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:44.463985 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:40:46.118551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:46.118521 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:40:46.124317 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:46.124294 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:40:52.727703 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:52.727665 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:40:52.886487 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:52.886446 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:40:57.850011 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:40:57.849974 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:00.733880 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:00.733848 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:01.304332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:01.304303 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:41:01.509179 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:01.509137 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:01.607825 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:01.607715 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:06.815117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:06.815016 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:06.919936 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:06.919899 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:07.019325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:07.019290 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:07.082726 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:07.082640 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:08.209369 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:08.209338 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:08.311244 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:08.311207 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:08.509496 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:08.509371 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:08.650905 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:08.650873 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:09.062625 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:09.062585 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:09.162617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:09.162583 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:09.323745 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:09.323657 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:09.423985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:09.423947 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:10.557723 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:10.557692 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:11.480488 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:11.480448 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:41:13.270137 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:13.270106 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:13.458530 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:13.458486 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:13.564004 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:13.563905 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:13.631478 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:13.631424 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:14.827540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:14.827508 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:19.455233 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:19.455191 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:19.516945 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:19.516911 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:19.809202 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:19.809161 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:19.889372 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:19.889337 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:20.882506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:20.882469 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:20.972257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:20.972223 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:21.053660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:21.053616 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:21.458730 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:21.458696 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:21.562169 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:21.562134 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:21.662137 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:21.662105 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:23.077862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:23.077826 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:24.087110 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:24.087068 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:41:25.963812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:25.963763 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:26.324031 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:26.323941 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:32.097952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:32.097905 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:32.196854 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:32.196816 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:35.638695 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:35.638663 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:35.895293 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:35.895199 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:41:38.417071 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:38.417020 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:38.517425 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:38.517389 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:38.626567 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:38.626529 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:39.798227 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:39.798190 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:39.897184 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:39.897142 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:40.015242 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:40.015194 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:40.360615 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:40.360580 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:40.461018 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:40.460981 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:42.125910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:42.125877 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:44.191086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:44.191046 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:44.388372 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:44.388336 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:44.511907 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:44.511819 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:44.572579 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:44.572539 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:45.605670 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:45.605643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:50.381915 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:50.381878 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:50.482892 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:50.482850 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:50.856787 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:50.856739 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:50.955879 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:50.955835 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:51.056347 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:51.056309 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:52.499939 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:52.499883 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:59.639150 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:59.639118 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:41:59.758812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:41:59.758757 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:15.336985 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:15.336954 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:25.076070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:25.076035 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:30.973272 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:30.973233 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:31.084994 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:31.084957 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:31.176539 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:31.176500 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:36.462586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:36.462493 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:47.119191 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:47.119160 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:52.769235 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:52.769193 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:52.835952 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:52.835920 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:52.910509 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:52.910470 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:42:53.007553 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:42:53.007506 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:03.499290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:03.499265 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:04.326831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:04.326795 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:10.088865 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:10.088828 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:10.198305 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:10.198248 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:10.288014 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:10.287973 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:10.387623 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:10.387532 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:11.760722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:11.760683 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:11.860568 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:11.860533 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:12.588960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:12.588926 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:43:12.991639 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:12.991603 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:19.117818 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:19.117748 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:19.186024 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:19.185994 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:19.786448 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:19.786406 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:21.782320 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:21.782277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:43:25.576136 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:25.576102 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:25.676855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:25.676797 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:25.817607 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:25.817578 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:26.134563 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:26.134533 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:26.256067 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:26.256027 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:29.312665 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:29.312632 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:29.403889 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:29.403850 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:29.476485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:29.476450 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:29.674983 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:29.674954 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:29.892754 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:29.892714 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:31.070265 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:31.070226 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:33.814877 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:33.814834 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:34.397732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:34.397701 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:43:34.500420 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:34.500375 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:34.596748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:34.596713 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:34.928568 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:34.928536 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:40.624154 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:40.624119 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:40.702874 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:40.702844 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:41.041365 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:41.041331 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:41.435870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:41.435836 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:41.536206 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:41.536163 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:46.090453 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:46.090416 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:43:47.372651 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:47.372622 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:47.455905 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:47.455869 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:47.622205 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:47.622173 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:47.872531 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:47.872493 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:48.000631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:48.000597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:49.049514 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:49.049481 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:49.150508 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:49.150472 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:53.951480 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:53.951441 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:54.023508 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:54.023472 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:54.118102 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:54.118058 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:54.217534 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:54.217453 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:43:54.317870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:43:54.317839 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:00.284926 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:00.284889 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:00.387748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:00.387709 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:04.923550 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:04.923507 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:04.981464 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:04.981425 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:07.121881 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:07.121798 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:07.477354 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:07.477318 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:07.709292 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:07.709258 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:07.801539 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:07.801433 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:10.494542 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:10.494504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:10.588576 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:10.588538 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:10.686661 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:10.686628 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:10.785460 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:10.785375 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:11.154167 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:11.154062 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:11.255387 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:11.255350 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:15.020218 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:15.020181 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:15.888910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:15.888876 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:44:40.907706 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:40.907670 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:44:43.985076 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:44:43.985037 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:45:03.284013 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:03.283974 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:45:07.954222 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:07.954183 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:08.373918 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:08.373827 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:14.045572 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:14.045538 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:14.081539 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:14.081508 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:45:19.091119 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:19.091082 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:24.292744 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:24.292717 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:45:46.153560 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:46.153535 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:45:46.160896 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:46.160875 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:45:55.215457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:55.215406 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:56.228578 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:56.228544 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:45:58.584706 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:45:58.584667 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:46:01.963475 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:01.963440 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:02.072106 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:02.072072 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:02.271044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:02.270938 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:02.499168 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:02.499125 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:03.644316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:03.644277 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:03.746440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:03.746406 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:03.847764 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:03.847725 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:04.588181 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:04.588100 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:04.687468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:04.687433 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:04.789868 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:04.789834 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:06.183953 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:06.183920 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:12.120870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:12.120833 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:13.270492 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:13.270458 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:13.370662 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:13.370629 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:18.670991 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:18.670954 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:18.742904 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:18.742868 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:18.859434 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:18.859395 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:18.958675 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:18.958582 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:29.429398 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:29.429360 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:29.804303 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:29.804206 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:50.736440 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:50.736397 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:56.580043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:56.580008 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:56.680433 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:56.680395 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:56.923319 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:56.923294 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:57.360230 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:57.360145 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:46:58.138879 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:46:58.138848 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:00.311479 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:00.311441 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:00.412112 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:00.412079 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:00.514755 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:00.514720 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:00.769604 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:00.769566 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:00.910910 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:00.910863 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:01.013616 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:01.013578 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:04.811455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:04.811410 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:05.164731 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:05.164694 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:05.746897 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:05.746848 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:05.848149 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:05.848117 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:08.352956 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:08.352916 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:08.459663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:08.459625 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:08.529294 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:08.529254 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:08.904762 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:08.904729 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:47:08.924844 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:08.924799 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:09.034028 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:09.033977 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:09.134964 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:09.134929 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:12.848597 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:12.848561 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:21.640275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:21.640240 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:21.737108 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:21.737075 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:22.100557 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:22.100526 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:25.087997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:25.087963 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:47:30.828391 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:30.828346 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:30.928081 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:30.928048 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:41.509984 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:41.509947 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:47:52.522932 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:52.522894 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:47:56.988979 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:47:56.988948 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:48:11.394361 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:11.394327 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:48:16.513631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:16.513597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:17.475830 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:17.475756 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:17.613297 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:17.613265 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:18.025648 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:18.025615 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:18.127117 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:18.127071 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:18.226212 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:18.226168 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:18.399453 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:18.399366 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:23.091003 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:23.090969 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:30.585645 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:30.585608 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:48:50.414452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:50.414420 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:48:59.925621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:48:59.925587 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:00.514155 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:00.514117 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:00.612337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:00.612297 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:00.777269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:00.777180 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:01.157438 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:01.157353 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:01.265546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:01.265504 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:01.367144 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:01.367107 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:01.504276 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:01.504237 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:04.392253 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:04.392221 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:49:07.119328 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:07.119293 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:07.183423 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:07.183385 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:07.513422 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:07.513371 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:07.620270 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:07.620232 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:07.960074 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:07.960038 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:08.305170 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:08.305060 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:08.723189 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:08.723154 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:08.897104 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:08.897070 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:09.025182 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:09.025063 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:10.985267 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:10.985196 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:11.081838 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:11.081800 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:11.198195 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:11.198163 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:11.295546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:11.295453 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:11.830631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:11.830593 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:11.931506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:11.931474 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:15.518043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:15.518003 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:15.983900 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:15.983863 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:16.293947 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:16.293859 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:16.764600 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:16.764559 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:19.031310 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.031272 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:19.206506 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.206462 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:19.255821 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.255760 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:49:19.379602 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.379507 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:19.546647 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.546604 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:19.995683 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:19.995647 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:20.110176 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:20.110139 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:23.518556 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:23.518510 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:31.739467 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:31.739423 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:32.078894 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:32.078753 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:32.248505 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:32.248473 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:32.351855 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:32.351742 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:32.496784 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:32.496740 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:35.480540 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:35.480508 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:49:37.977453 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:37.977408 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:38.047481 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:38.047443 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:38.671250 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:38.671212 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:38.771848 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:38.771799 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:39.040357 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:39.040266 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:39.141129 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:39.141091 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:39.261221 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:39.261190 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:39.446634 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:39.446606 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:44.783205 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:44.783162 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:44.880219 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:44.880189 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:45.103210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:45.103120 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:45.297045 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:45.297013 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:45.625619 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:45.625578 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:47.830918 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:47.830875 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:49.221458 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:49.221419 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:49.291399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:49.291351 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:49.371996 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:49.371958 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:49.888630 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:49.888597 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:49.989088 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:49.989048 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:50.284594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:50.284561 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:49:53.738640 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:53.738604 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:54.074240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:54.074141 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:54.486788 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:54.486739 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:54.591582 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:54.591522 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:57.278523 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:57.278483 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:57.372297 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:57.372267 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:57.521304 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:57.521266 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:57.621375 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:57.621290 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:57.960660 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:57.960623 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:49:58.061471 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:49:58.061440 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:01.763886 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:01.763854 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:05.692718 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:05.692679 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:50:10.655915 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:10.655878 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:10.761143 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:10.761089 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:20.002960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:20.002927 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:20.119498 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:20.119449 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:27.617469 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:27.617431 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:31.183912 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:31.183866 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:50:45.385307 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.385270 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:50:45.388817 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.388800 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.392456 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.392426 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6bf011\"/\"default-dockercfg-ljp6q\"" Jul 09 16:50:45.392603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.392427 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6bf011\"/\"kube-root-ca.crt\"" Jul 09 16:50:45.392603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.392436 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-6bf011\"/\"auth-test-model-6bf011-kserve-self-signed-certs\"" Jul 09 16:50:45.392603 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.392475 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-6bf011\"/\"openshift-service-ca.crt\"" Jul 09 16:50:45.396510 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.396489 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:50:45.491082 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.491049 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:45.493997 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.493976 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqdwt\" (UniqueName: \"kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.494062 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.494011 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.494062 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.494039 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.494177 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.494094 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.494177 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.494121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.494241 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.494187 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.594974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.594921 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.594974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.594987 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqdwt\" (UniqueName: \"kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595030 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595059 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595100 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595132 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595548 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595520 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595586 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595531 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.595629 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.595608 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.597525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.597500 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.597758 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.597737 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.603026 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.602999 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqdwt\" (UniqueName: \"kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt\") pod \"auth-test-model-6bf011-kserve-55f998db79-zxwd4\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.699416 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.699375 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:45.843541 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:45.843512 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:50:45.845293 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:50:45.845260 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd49c472f_f859_4167_8634_66d6510dd6d2.slice/crio-bb5d35641c6082a462e52ac8a7961c66f3a5d6c067c0e9547d1bb6716ced38f6 WatchSource:0}: Error finding container bb5d35641c6082a462e52ac8a7961c66f3a5d6c067c0e9547d1bb6716ced38f6: Status 404 returned error can't find the container with id bb5d35641c6082a462e52ac8a7961c66f3a5d6c067c0e9547d1bb6716ced38f6 Jul 09 16:50:46.188831 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:46.188802 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:50:46.196343 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:46.196318 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:50:46.837062 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:46.837027 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" event={"ID":"d49c472f-f859-4167-8634-66d6510dd6d2","Type":"ContainerStarted","Data":"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b"} Jul 09 16:50:46.837441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:46.837069 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" event={"ID":"d49c472f-f859-4167-8634-66d6510dd6d2","Type":"ContainerStarted","Data":"bb5d35641c6082a462e52ac8a7961c66f3a5d6c067c0e9547d1bb6716ced38f6"} Jul 09 16:50:46.855054 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:46.855006 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" podStartSLOduration=1.8549903269999999 podStartE2EDuration="1.854990327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:50:46.854038145 +0000 UTC m=+2101.242520532" watchObservedRunningTime="2026-07-09 16:50:46.854990327 +0000 UTC m=+2101.243472715" Jul 09 16:50:49.105685 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:49.105646 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:50:49.591043 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:49.591013 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:50:55.699584 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:55.699551 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:55.700050 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:55.699608 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:55.712079 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:55.712053 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:50:55.897838 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:50:55.897807 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:51:06.686566 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:51:06.686531 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:51:22.498329 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:51:22.498291 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:51:24.484240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:51:24.484198 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:51:41.683967 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:51:41.683930 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:51:59.585164 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:51:59.585129 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:52:15.593001 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:15.592965 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:52:18.137380 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:18.137337 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:18.192301 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:18.192268 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:33.391382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:33.391338 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:52:46.796939 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:46.796868 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:47.704374 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:47.704343 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:52:47.722933 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:47.722898 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:52:50.491779 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:50.491731 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:52:57.712552 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:52:57.712508 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:02.726307 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:02.726245 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" podUID="d49c472f-f859-4167-8634-66d6510dd6d2" containerName="main" containerID="cri-o://020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b" gracePeriod=45 Jul 09 16:53:02.997533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:02.997506 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:53:03.025477 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025449 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.025656 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025527 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.025656 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025565 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqdwt\" (UniqueName: \"kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.025656 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025597 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.025878 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025689 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home" (OuterVolumeSpecName: "home") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:53:03.025878 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025695 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.025878 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025754 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache\") pod \"d49c472f-f859-4167-8634-66d6510dd6d2\" (UID: \"d49c472f-f859-4167-8634-66d6510dd6d2\") " Jul 09 16:53:03.026048 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025885 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:53:03.026048 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.025974 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache" (OuterVolumeSpecName: "model-cache") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:53:03.026154 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.026096 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-home\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.026154 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.026111 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-tmp-dir\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.026154 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.026120 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-model-cache\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.028115 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.028090 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:53:03.028227 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.028132 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm" (OuterVolumeSpecName: "dshm") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:53:03.028227 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.028144 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt" (OuterVolumeSpecName: "kube-api-access-fqdwt") pod "d49c472f-f859-4167-8634-66d6510dd6d2" (UID: "d49c472f-f859-4167-8634-66d6510dd6d2"). InnerVolumeSpecName "kube-api-access-fqdwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:53:03.127145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.127112 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d49c472f-f859-4167-8634-66d6510dd6d2-tls-certs\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.127145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.127139 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d49c472f-f859-4167-8634-66d6510dd6d2-dshm\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.127145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.127148 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqdwt\" (UniqueName: \"kubernetes.io/projected/d49c472f-f859-4167-8634-66d6510dd6d2-kube-api-access-fqdwt\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:53:03.568866 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.568817 2571 generic.go:356] "Generic (PLEG): container finished" podID="d49c472f-f859-4167-8634-66d6510dd6d2" containerID="020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b" exitCode=0 Jul 09 16:53:03.568866 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.568866 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" Jul 09 16:53:03.569102 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.568875 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" event={"ID":"d49c472f-f859-4167-8634-66d6510dd6d2","Type":"ContainerDied","Data":"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b"} Jul 09 16:53:03.569102 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.568908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4" event={"ID":"d49c472f-f859-4167-8634-66d6510dd6d2","Type":"ContainerDied","Data":"bb5d35641c6082a462e52ac8a7961c66f3a5d6c067c0e9547d1bb6716ced38f6"} Jul 09 16:53:03.569102 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.568925 2571 scope.go:117] "RemoveContainer" containerID="020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b" Jul 09 16:53:03.578316 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.578299 2571 scope.go:117] "RemoveContainer" containerID="020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b" Jul 09 16:53:03.578555 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:53:03.578535 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b\": container with ID starting with 020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b not found: ID does not exist" containerID="020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b" Jul 09 16:53:03.578621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.578563 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b"} err="failed to get container status \"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b\": rpc error: code = NotFound desc = could not find container \"020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b\": container with ID starting with 020ffd3026689705a505fa035cff8e026321e0e4f852b6fdc40ead218c8dc83b not found: ID does not exist" Jul 09 16:53:03.590149 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.590124 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:53:03.593871 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:03.593845 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-6bf011/auth-test-model-6bf011-kserve-55f998db79-zxwd4"] Jul 09 16:53:04.134920 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:04.134883 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49c472f-f859-4167-8634-66d6510dd6d2" path="/var/lib/kubelet/pods/d49c472f-f859-4167-8634-66d6510dd6d2/volumes" Jul 09 16:53:12.490139 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:12.490057 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:53:24.126587 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:24.126542 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:24.184061 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:24.184028 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:38.597285 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:38.597238 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:53:42.289280 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:53:42.289249 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:54:03.888669 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:03.888629 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:54:09.820442 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:09.820390 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:09.936057 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:09.936020 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:24.992704 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:24.992668 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:54:31.725970 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:31.725934 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:32.599450 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:32.599418 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:36.390881 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.390799 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:54:36.391377 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.391358 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49c472f-f859-4167-8634-66d6510dd6d2" containerName="main" Jul 09 16:54:36.391457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.391381 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49c472f-f859-4167-8634-66d6510dd6d2" containerName="main" Jul 09 16:54:36.391511 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.391477 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49c472f-f859-4167-8634-66d6510dd6d2" containerName="main" Jul 09 16:54:36.394659 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.394639 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.397441 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.397419 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bef56b\"/\"openshift-service-ca.crt\"" Jul 09 16:54:36.398794 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.398760 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bef56b\"/\"rate-test-model-bef56b-kserve-self-signed-certs\"" Jul 09 16:54:36.398916 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.398798 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bef56b\"/\"kube-root-ca.crt\"" Jul 09 16:54:36.398916 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.398762 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bef56b\"/\"default-dockercfg-vj8gl\"" Jul 09 16:54:36.402703 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.402677 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:54:36.412916 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.412887 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:54:36.452928 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.452899 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.452928 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.452934 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.453193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.452956 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.453193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.453048 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.453193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.453103 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.453193 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.453146 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqlv\" (UniqueName: \"kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554691 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554717 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.554929 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.554748 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqlv\" (UniqueName: \"kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.555143 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.555108 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.555202 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.555181 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.555254 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.555204 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.557110 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.557090 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.557381 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.557362 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.563163 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.563131 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqlv\" (UniqueName: \"kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv\") pod \"rate-test-model-bef56b-kserve-5487875575-f74l2\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.704533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.704489 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:36.859080 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:36.858995 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:54:37.075066 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:37.074978 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" event={"ID":"b5626f94-747e-4d23-a20e-d9e018938b11","Type":"ContainerStarted","Data":"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6"} Jul 09 16:54:37.075066 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:37.075020 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" event={"ID":"b5626f94-747e-4d23-a20e-d9e018938b11","Type":"ContainerStarted","Data":"036d24315bccf4b1b3e83b40aeecc73294be5ad6e827a69b972e45781f193c96"} Jul 09 16:54:37.091963 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:37.091912 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" podStartSLOduration=1.091896867 podStartE2EDuration="1.091896867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:54:37.090306164 +0000 UTC m=+2331.478788564" watchObservedRunningTime="2026-07-09 16:54:37.091896867 +0000 UTC m=+2331.480379290" Jul 09 16:54:44.887426 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:44.887378 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:54:46.704869 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:46.704832 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:46.705382 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:46.704892 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:46.717633 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:46.717594 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:54:47.146248 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:54:47.146162 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:55:02.181657 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:02.181627 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:07.185421 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:07.185381 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:55:11.538879 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:11.538833 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:11.716180 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:11.716128 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:20.908395 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:20.908354 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:21.011322 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:21.011288 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:22.089551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:22.089517 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:55:38.287657 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:38.287621 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:55:45.822134 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:45.822099 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:55:45.852918 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:45.852882 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:46.233824 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:46.233761 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:55:46.240127 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:46.240108 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qg8db_f64a4a0d-800a-4daa-b045-5a83fed98bfd/ovn-acl-logging/0.log" Jul 09 16:55:46.794437 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:46.794404 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:55:47.763368 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:47.763340 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472036528"] Jul 09 16:55:47.766958 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:47.766942 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:47.771974 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:47.771949 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-lcqn7\"" Jul 09 16:55:47.784652 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:47.784623 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472036528"] Jul 09 16:55:47.900944 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:47.900893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttvw\" (UniqueName: \"kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw\") pod \"test-curl-7418-140524472036528\" (UID: \"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70\") " pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:48.002332 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.002272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttvw\" (UniqueName: \"kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw\") pod \"test-curl-7418-140524472036528\" (UID: \"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70\") " pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:48.012198 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.012174 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttvw\" (UniqueName: \"kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw\") pod \"test-curl-7418-140524472036528\" (UID: \"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70\") " pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:48.075709 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.075635 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:48.209312 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.209289 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472036528"] Jul 09 16:55:48.211372 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:55:48.211338 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a6b8fb9_f0ef_422a_9eb4_b8e22f5aec70.slice/crio-454d5bdc2e698d96f0f7e81decf225e4a5f54e3261e48f80d31157cbc5d50414 WatchSource:0}: Error finding container 454d5bdc2e698d96f0f7e81decf225e4a5f54e3261e48f80d31157cbc5d50414: Status 404 returned error can't find the container with id 454d5bdc2e698d96f0f7e81decf225e4a5f54e3261e48f80d31157cbc5d50414 Jul 09 16:55:48.212691 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.212670 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:55:48.457653 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:48.457614 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472036528" event={"ID":"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70","Type":"ContainerStarted","Data":"454d5bdc2e698d96f0f7e81decf225e4a5f54e3261e48f80d31157cbc5d50414"} Jul 09 16:55:49.465056 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:49.465019 2571 generic.go:356] "Generic (PLEG): container finished" podID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" containerID="dd96f8dd25db35f44f503441827c9bd9ceb6c06cf26b34813dada1a5231f7b5f" exitCode=0 Jul 09 16:55:49.465446 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:49.465100 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472036528" event={"ID":"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70","Type":"ContainerDied","Data":"dd96f8dd25db35f44f503441827c9bd9ceb6c06cf26b34813dada1a5231f7b5f"} Jul 09 16:55:50.614942 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.614914 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:50.635359 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.635337 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472036528_6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70/test-curl-7418-140524472036528/0.log" Jul 09 16:55:50.660733 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.660698 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472036528"] Jul 09 16:55:50.664754 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.664727 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472036528"] Jul 09 16:55:50.727514 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.727424 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lttvw\" (UniqueName: \"kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw\") pod \"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70\" (UID: \"6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70\") " Jul 09 16:55:50.729654 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.729630 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw" (OuterVolumeSpecName: "kube-api-access-lttvw") pod "6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" (UID: "6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70"). InnerVolumeSpecName "kube-api-access-lttvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:50.785044 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.785006 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472029488"] Jul 09 16:55:50.785378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.785366 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" containerName="test-curl-7418-140524472036528" Jul 09 16:55:50.785425 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.785380 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" containerName="test-curl-7418-140524472036528" Jul 09 16:55:50.785461 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.785446 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" containerName="test-curl-7418-140524472036528" Jul 09 16:55:50.788153 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.788137 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:50.794455 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.794423 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472029488"] Jul 09 16:55:50.828982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.828945 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lttvw\" (UniqueName: \"kubernetes.io/projected/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70-kube-api-access-lttvw\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:55:50.930023 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:50.929984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svwkh\" (UniqueName: \"kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh\") pod \"test-curl-7418-140524472029488\" (UID: \"603d5961-bd22-44a9-b599-fab2b4942e07\") " pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:51.031608 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.031510 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svwkh\" (UniqueName: \"kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh\") pod \"test-curl-7418-140524472029488\" (UID: \"603d5961-bd22-44a9-b599-fab2b4942e07\") " pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:51.039648 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.039626 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svwkh\" (UniqueName: \"kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh\") pod \"test-curl-7418-140524472029488\" (UID: \"603d5961-bd22-44a9-b599-fab2b4942e07\") " pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:51.097722 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.097676 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:51.242303 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.242267 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472029488"] Jul 09 16:55:51.476336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.476305 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:51.476336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.476328 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="454d5bdc2e698d96f0f7e81decf225e4a5f54e3261e48f80d31157cbc5d50414" Jul 09 16:55:51.477562 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:51.477534 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472029488" event={"ID":"603d5961-bd22-44a9-b599-fab2b4942e07","Type":"ContainerStarted","Data":"12b9e4febbbd0236bfc170c3981e613734fd9dd2add6e6df24986452ad89fc37"} Jul 09 16:55:51.487104 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:55:51.487070 2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7418-140524472036528\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" pod="openshift-ingress/test-curl-7418-140524472036528" Jul 09 16:55:52.135308 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:52.135273 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70" path="/var/lib/kubelet/pods/6a6b8fb9-f0ef-422a-9eb4-b8e22f5aec70/volumes" Jul 09 16:55:52.484593 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:52.484555 2571 generic.go:356] "Generic (PLEG): container finished" podID="603d5961-bd22-44a9-b599-fab2b4942e07" containerID="855cea6de325588f8f87a7c7225ba56145db752beabfc6f77bf4190074706521" exitCode=0 Jul 09 16:55:52.484799 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:52.484646 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472029488" event={"ID":"603d5961-bd22-44a9-b599-fab2b4942e07","Type":"ContainerDied","Data":"855cea6de325588f8f87a7c7225ba56145db752beabfc6f77bf4190074706521"} Jul 09 16:55:53.121121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.121091 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:55:53.636157 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.636126 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:53.657543 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.657517 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472029488_603d5961-bd22-44a9-b599-fab2b4942e07/test-curl-7418-140524472029488/0.log" Jul 09 16:55:53.680216 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.680186 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472029488"] Jul 09 16:55:53.683634 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.683606 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472029488"] Jul 09 16:55:53.756631 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.756540 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svwkh\" (UniqueName: \"kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh\") pod \"603d5961-bd22-44a9-b599-fab2b4942e07\" (UID: \"603d5961-bd22-44a9-b599-fab2b4942e07\") " Jul 09 16:55:53.758919 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.758885 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh" (OuterVolumeSpecName: "kube-api-access-svwkh") pod "603d5961-bd22-44a9-b599-fab2b4942e07" (UID: "603d5961-bd22-44a9-b599-fab2b4942e07"). InnerVolumeSpecName "kube-api-access-svwkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:53.846159 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.846124 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:53.846485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.846472 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="603d5961-bd22-44a9-b599-fab2b4942e07" containerName="test-curl-7418-140524472029488" Jul 09 16:55:53.846528 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.846486 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="603d5961-bd22-44a9-b599-fab2b4942e07" containerName="test-curl-7418-140524472029488" Jul 09 16:55:53.846568 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.846554 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="603d5961-bd22-44a9-b599-fab2b4942e07" containerName="test-curl-7418-140524472029488" Jul 09 16:55:53.849378 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.849363 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:53.855114 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.855089 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:53.857667 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.857641 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svwkh\" (UniqueName: \"kubernetes.io/projected/603d5961-bd22-44a9-b599-fab2b4942e07-kube-api-access-svwkh\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:55:53.958128 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:53.958091 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dcq\" (UniqueName: \"kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq\") pod \"test-curl-7418-140524472244096\" (UID: \"aa3757a9-cef8-45d8-9b68-1a9ada67675d\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:54.059492 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.059386 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dcq\" (UniqueName: \"kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq\") pod \"test-curl-7418-140524472244096\" (UID: \"aa3757a9-cef8-45d8-9b68-1a9ada67675d\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:54.068698 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.068671 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dcq\" (UniqueName: \"kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq\") pod \"test-curl-7418-140524472244096\" (UID: \"aa3757a9-cef8-45d8-9b68-1a9ada67675d\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:54.136322 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.136287 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="603d5961-bd22-44a9-b599-fab2b4942e07" path="/var/lib/kubelet/pods/603d5961-bd22-44a9-b599-fab2b4942e07/volumes" Jul 09 16:55:54.159812 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.159785 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:54.296246 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.296216 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:54.298204 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:55:54.298177 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa3757a9_cef8_45d8_9b68_1a9ada67675d.slice/crio-c6d4ccb68d2c43dd1853165112cb5cc81c0004fa92bdc6970a07ce59f69c7d7b WatchSource:0}: Error finding container c6d4ccb68d2c43dd1853165112cb5cc81c0004fa92bdc6970a07ce59f69c7d7b: Status 404 returned error can't find the container with id c6d4ccb68d2c43dd1853165112cb5cc81c0004fa92bdc6970a07ce59f69c7d7b Jul 09 16:55:54.496379 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.496341 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472244096" event={"ID":"aa3757a9-cef8-45d8-9b68-1a9ada67675d","Type":"ContainerStarted","Data":"c6d4ccb68d2c43dd1853165112cb5cc81c0004fa92bdc6970a07ce59f69c7d7b"} Jul 09 16:55:54.497533 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.497515 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472029488" Jul 09 16:55:54.497621 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:54.497521 2571 scope.go:117] "RemoveContainer" containerID="855cea6de325588f8f87a7c7225ba56145db752beabfc6f77bf4190074706521" Jul 09 16:55:55.506269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:55.506231 2571 generic.go:356] "Generic (PLEG): container finished" podID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" containerID="f0b7019a5b97f20805e44b54843ae2134f97e71110d71486eca296df5acedd71" exitCode=0 Jul 09 16:55:55.506720 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:55.506316 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472244096" event={"ID":"aa3757a9-cef8-45d8-9b68-1a9ada67675d","Type":"ContainerDied","Data":"f0b7019a5b97f20805e44b54843ae2134f97e71110d71486eca296df5acedd71"} Jul 09 16:55:56.647307 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.647279 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:56.692275 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.692250 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472244096_aa3757a9-cef8-45d8-9b68-1a9ada67675d/test-curl-7418-140524472244096/0.log" Jul 09 16:55:56.717763 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.717734 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:56.722933 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.722909 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:56.784908 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.784835 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7dcq\" (UniqueName: \"kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq\") pod \"aa3757a9-cef8-45d8-9b68-1a9ada67675d\" (UID: \"aa3757a9-cef8-45d8-9b68-1a9ada67675d\") " Jul 09 16:55:56.786977 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.786951 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq" (OuterVolumeSpecName: "kube-api-access-x7dcq") pod "aa3757a9-cef8-45d8-9b68-1a9ada67675d" (UID: "aa3757a9-cef8-45d8-9b68-1a9ada67675d"). InnerVolumeSpecName "kube-api-access-x7dcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:56.851271 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.851232 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:56.851605 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.851592 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" containerName="test-curl-7418-140524472244096" Jul 09 16:55:56.851650 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.851606 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" containerName="test-curl-7418-140524472244096" Jul 09 16:55:56.851697 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.851676 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" containerName="test-curl-7418-140524472244096" Jul 09 16:55:56.854594 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.854580 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:56.859354 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.859329 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:56.886054 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.886025 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7dcq\" (UniqueName: \"kubernetes.io/projected/aa3757a9-cef8-45d8-9b68-1a9ada67675d-kube-api-access-x7dcq\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:55:56.986761 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:56.986717 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2m9t\" (UniqueName: \"kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t\") pod \"test-curl-7418-140524472244096\" (UID: \"9c0c14d3-8655-4e19-b281-73f2eec1204f\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:57.087798 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.087689 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2m9t\" (UniqueName: \"kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t\") pod \"test-curl-7418-140524472244096\" (UID: \"9c0c14d3-8655-4e19-b281-73f2eec1204f\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:57.097370 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.097344 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2m9t\" (UniqueName: \"kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t\") pod \"test-curl-7418-140524472244096\" (UID: \"9c0c14d3-8655-4e19-b281-73f2eec1204f\") " pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:57.166215 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.166181 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:57.304188 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.304159 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:57.305532 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:55:57.305502 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c0c14d3_8655_4e19_b281_73f2eec1204f.slice/crio-d480cd763e24508dd0d266eb50dd2111188cc95197a7ef684698ef1a934f234b WatchSource:0}: Error finding container d480cd763e24508dd0d266eb50dd2111188cc95197a7ef684698ef1a934f234b: Status 404 returned error can't find the container with id d480cd763e24508dd0d266eb50dd2111188cc95197a7ef684698ef1a934f234b Jul 09 16:55:57.517485 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.517444 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472244096" event={"ID":"9c0c14d3-8655-4e19-b281-73f2eec1204f","Type":"ContainerStarted","Data":"d480cd763e24508dd0d266eb50dd2111188cc95197a7ef684698ef1a934f234b"} Jul 09 16:55:57.518723 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.518707 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:57.518723 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.518720 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6d4ccb68d2c43dd1853165112cb5cc81c0004fa92bdc6970a07ce59f69c7d7b" Jul 09 16:55:57.529867 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:57.529830 2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7418-140524472244096" oldPodUID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" podUID="9c0c14d3-8655-4e19-b281-73f2eec1204f" Jul 09 16:55:58.135838 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:58.135804 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa3757a9-cef8-45d8-9b68-1a9ada67675d" path="/var/lib/kubelet/pods/aa3757a9-cef8-45d8-9b68-1a9ada67675d/volumes" Jul 09 16:55:58.526457 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:58.526416 2571 generic.go:356] "Generic (PLEG): container finished" podID="9c0c14d3-8655-4e19-b281-73f2eec1204f" containerID="b1dfbd95197b4165ad9f3e529bd54583a80b652832977d649b0a8249f93296be" exitCode=0 Jul 09 16:55:58.526616 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:58.526501 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472244096" event={"ID":"9c0c14d3-8655-4e19-b281-73f2eec1204f","Type":"ContainerDied","Data":"b1dfbd95197b4165ad9f3e529bd54583a80b652832977d649b0a8249f93296be"} Jul 09 16:55:59.669358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.669324 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:55:59.694948 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.694914 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472244096_9c0c14d3-8655-4e19-b281-73f2eec1204f/test-curl-7418-140524472244096/0.log" Jul 09 16:55:59.721669 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.721635 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:59.724442 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.724419 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472244096"] Jul 09 16:55:59.810958 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.810861 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2m9t\" (UniqueName: \"kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t\") pod \"9c0c14d3-8655-4e19-b281-73f2eec1204f\" (UID: \"9c0c14d3-8655-4e19-b281-73f2eec1204f\") " Jul 09 16:55:59.813116 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.813091 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t" (OuterVolumeSpecName: "kube-api-access-t2m9t") pod "9c0c14d3-8655-4e19-b281-73f2eec1204f" (UID: "9c0c14d3-8655-4e19-b281-73f2eec1204f"). InnerVolumeSpecName "kube-api-access-t2m9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:59.845960 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.845919 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:55:59.846372 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.846354 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0c14d3-8655-4e19-b281-73f2eec1204f" containerName="test-curl-7418-140524472244096" Jul 09 16:55:59.846451 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.846376 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0c14d3-8655-4e19-b281-73f2eec1204f" containerName="test-curl-7418-140524472244096" Jul 09 16:55:59.846517 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.846495 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0c14d3-8655-4e19-b281-73f2eec1204f" containerName="test-curl-7418-140524472244096" Jul 09 16:55:59.849416 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.849396 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:55:59.854717 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.854690 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:55:59.912070 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:55:59.912041 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2m9t\" (UniqueName: \"kubernetes.io/projected/9c0c14d3-8655-4e19-b281-73f2eec1204f-kube-api-access-t2m9t\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:00.012620 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.012583 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkb8f\" (UniqueName: \"kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f\") pod \"test-curl-7418-140524472245104\" (UID: \"38a5a733-eca9-4068-9608-6d7886a07e16\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:00.113477 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.113373 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkb8f\" (UniqueName: \"kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f\") pod \"test-curl-7418-140524472245104\" (UID: \"38a5a733-eca9-4068-9608-6d7886a07e16\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:00.124020 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.123989 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkb8f\" (UniqueName: \"kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f\") pod \"test-curl-7418-140524472245104\" (UID: \"38a5a733-eca9-4068-9608-6d7886a07e16\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:00.136064 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.136036 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0c14d3-8655-4e19-b281-73f2eec1204f" path="/var/lib/kubelet/pods/9c0c14d3-8655-4e19-b281-73f2eec1204f/volumes" Jul 09 16:56:00.159971 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.159940 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:00.294496 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.294471 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:00.295333 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:56:00.295299 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38a5a733_eca9_4068_9608_6d7886a07e16.slice/crio-cdb1961f403b4475864f56380e0bc648f93b1b783fab72db9505a02a1704a481 WatchSource:0}: Error finding container cdb1961f403b4475864f56380e0bc648f93b1b783fab72db9505a02a1704a481: Status 404 returned error can't find the container with id cdb1961f403b4475864f56380e0bc648f93b1b783fab72db9505a02a1704a481 Jul 09 16:56:00.540384 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.540354 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472244096" Jul 09 16:56:00.540384 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.540373 2571 scope.go:117] "RemoveContainer" containerID="b1dfbd95197b4165ad9f3e529bd54583a80b652832977d649b0a8249f93296be" Jul 09 16:56:00.542007 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.541864 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472245104" event={"ID":"38a5a733-eca9-4068-9608-6d7886a07e16","Type":"ContainerStarted","Data":"cdb1961f403b4475864f56380e0bc648f93b1b783fab72db9505a02a1704a481"} Jul 09 16:56:00.844185 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:00.844140 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" podUID="b5626f94-747e-4d23-a20e-d9e018938b11" containerName="main" containerID="cri-o://0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6" gracePeriod=45 Jul 09 16:56:01.089256 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.089231 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:56:01.224256 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224164 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224256 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224216 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224256 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224238 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwqlv\" (UniqueName: \"kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224302 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224324 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224360 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs\") pod \"b5626f94-747e-4d23-a20e-d9e018938b11\" (UID: \"b5626f94-747e-4d23-a20e-d9e018938b11\") " Jul 09 16:56:01.224551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224514 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache" (OuterVolumeSpecName: "model-cache") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:56:01.224551 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224548 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:56:01.224800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224656 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home" (OuterVolumeSpecName: "home") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:56:01.224800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224664 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-tmp-dir\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.224800 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.224706 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-model-cache\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.226606 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.226581 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm" (OuterVolumeSpecName: "dshm") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:56:01.226606 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.226584 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:56:01.226748 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.226621 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv" (OuterVolumeSpecName: "kube-api-access-wwqlv") pod "b5626f94-747e-4d23-a20e-d9e018938b11" (UID: "b5626f94-747e-4d23-a20e-d9e018938b11"). InnerVolumeSpecName "kube-api-access-wwqlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:56:01.325549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.325520 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-home\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.325549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.325546 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5626f94-747e-4d23-a20e-d9e018938b11-tls-certs\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.325549 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.325555 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5626f94-747e-4d23-a20e-d9e018938b11-dshm\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.325818 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.325564 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwqlv\" (UniqueName: \"kubernetes.io/projected/b5626f94-747e-4d23-a20e-d9e018938b11-kube-api-access-wwqlv\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:01.550054 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.549965 2571 generic.go:356] "Generic (PLEG): container finished" podID="38a5a733-eca9-4068-9608-6d7886a07e16" containerID="817a5894029fb6579f105f47cdbb3fea042cb763804ef3236142ba91c6ae1681" exitCode=0 Jul 09 16:56:01.550206 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.550054 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472245104" event={"ID":"38a5a733-eca9-4068-9608-6d7886a07e16","Type":"ContainerDied","Data":"817a5894029fb6579f105f47cdbb3fea042cb763804ef3236142ba91c6ae1681"} Jul 09 16:56:01.551300 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.551280 2571 generic.go:356] "Generic (PLEG): container finished" podID="b5626f94-747e-4d23-a20e-d9e018938b11" containerID="0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6" exitCode=0 Jul 09 16:56:01.551385 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.551312 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" Jul 09 16:56:01.551385 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.551341 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" event={"ID":"b5626f94-747e-4d23-a20e-d9e018938b11","Type":"ContainerDied","Data":"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6"} Jul 09 16:56:01.551385 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.551371 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2" event={"ID":"b5626f94-747e-4d23-a20e-d9e018938b11","Type":"ContainerDied","Data":"036d24315bccf4b1b3e83b40aeecc73294be5ad6e827a69b972e45781f193c96"} Jul 09 16:56:01.551481 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.551429 2571 scope.go:117] "RemoveContainer" containerID="0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6" Jul 09 16:56:01.560839 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.560821 2571 scope.go:117] "RemoveContainer" containerID="0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6" Jul 09 16:56:01.561089 ip-10-0-139-93 kubenswrapper[2571]: E0709 16:56:01.561068 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6\": container with ID starting with 0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6 not found: ID does not exist" containerID="0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6" Jul 09 16:56:01.561149 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.561096 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6"} err="failed to get container status \"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6\": rpc error: code = NotFound desc = could not find container \"0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6\": container with ID starting with 0906a425acd0df279a6dc44d041aed25a733c8684abccfa2ba7534bb23ff96a6 not found: ID does not exist" Jul 09 16:56:01.578492 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.578457 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:56:01.581598 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:01.581576 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bef56b/rate-test-model-bef56b-kserve-5487875575-f74l2"] Jul 09 16:56:02.136177 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.136148 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5626f94-747e-4d23-a20e-d9e018938b11" path="/var/lib/kubelet/pods/b5626f94-747e-4d23-a20e-d9e018938b11/volumes" Jul 09 16:56:02.698862 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.698833 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:02.722452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.722421 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472245104_38a5a733-eca9-4068-9608-6d7886a07e16/test-curl-7418-140524472245104/0.log" Jul 09 16:56:02.738815 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.738790 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkb8f\" (UniqueName: \"kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f\") pod \"38a5a733-eca9-4068-9608-6d7886a07e16\" (UID: \"38a5a733-eca9-4068-9608-6d7886a07e16\") " Jul 09 16:56:02.741081 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.741055 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f" (OuterVolumeSpecName: "kube-api-access-hkb8f") pod "38a5a733-eca9-4068-9608-6d7886a07e16" (UID: "38a5a733-eca9-4068-9608-6d7886a07e16"). InnerVolumeSpecName "kube-api-access-hkb8f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:56:02.749829 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.749807 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:02.754708 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.754688 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:02.839612 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.839526 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkb8f\" (UniqueName: \"kubernetes.io/projected/38a5a733-eca9-4068-9608-6d7886a07e16-kube-api-access-hkb8f\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:02.878326 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878293 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:02.878651 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878639 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5626f94-747e-4d23-a20e-d9e018938b11" containerName="main" Jul 09 16:56:02.878694 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878653 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5626f94-747e-4d23-a20e-d9e018938b11" containerName="main" Jul 09 16:56:02.878694 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878675 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a5a733-eca9-4068-9608-6d7886a07e16" containerName="test-curl-7418-140524472245104" Jul 09 16:56:02.878694 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878681 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a5a733-eca9-4068-9608-6d7886a07e16" containerName="test-curl-7418-140524472245104" Jul 09 16:56:02.878808 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878733 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a5a733-eca9-4068-9608-6d7886a07e16" containerName="test-curl-7418-140524472245104" Jul 09 16:56:02.878808 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.878742 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5626f94-747e-4d23-a20e-d9e018938b11" containerName="main" Jul 09 16:56:02.882076 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.882061 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:02.889734 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.889701 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:02.940059 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:02.940022 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j4g\" (UniqueName: \"kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g\") pod \"test-curl-7418-140524472245104\" (UID: \"8c5b62c1-b639-47cd-a2c7-825c7c4c459c\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:03.040937 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.040895 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j4g\" (UniqueName: \"kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g\") pod \"test-curl-7418-140524472245104\" (UID: \"8c5b62c1-b639-47cd-a2c7-825c7c4c459c\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:03.050100 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.050066 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j4g\" (UniqueName: \"kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g\") pod \"test-curl-7418-140524472245104\" (UID: \"8c5b62c1-b639-47cd-a2c7-825c7c4c459c\") " pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:03.191290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.191243 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:03.333737 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.333697 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:03.335123 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:56:03.335096 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c5b62c1_b639_47cd_a2c7_825c7c4c459c.slice/crio-9d7d077a2983b7a3a47a3f05ecc4e869ec4e4e4a2cf46efb812fc81c23a4a349 WatchSource:0}: Error finding container 9d7d077a2983b7a3a47a3f05ecc4e869ec4e4e4a2cf46efb812fc81c23a4a349: Status 404 returned error can't find the container with id 9d7d077a2983b7a3a47a3f05ecc4e869ec4e4e4a2cf46efb812fc81c23a4a349 Jul 09 16:56:03.564727 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.564637 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdb1961f403b4475864f56380e0bc648f93b1b783fab72db9505a02a1704a481" Jul 09 16:56:03.564727 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.564638 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:03.565931 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.565901 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472245104" event={"ID":"8c5b62c1-b639-47cd-a2c7-825c7c4c459c","Type":"ContainerStarted","Data":"9d7d077a2983b7a3a47a3f05ecc4e869ec4e4e4a2cf46efb812fc81c23a4a349"} Jul 09 16:56:03.576307 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:03.576280 2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="openshift-ingress/test-curl-7418-140524472245104" oldPodUID="38a5a733-eca9-4068-9608-6d7886a07e16" podUID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" Jul 09 16:56:04.136379 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:04.136346 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a5a733-eca9-4068-9608-6d7886a07e16" path="/var/lib/kubelet/pods/38a5a733-eca9-4068-9608-6d7886a07e16/volumes" Jul 09 16:56:04.572055 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:04.572020 2571 generic.go:356] "Generic (PLEG): container finished" podID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" containerID="526f1fd983e7e5e267955ee2f1c871e04d427ff02666a94f41f5d51d78f9f644" exitCode=0 Jul 09 16:56:04.572452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:04.572107 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7418-140524472245104" event={"ID":"8c5b62c1-b639-47cd-a2c7-825c7c4c459c","Type":"ContainerDied","Data":"526f1fd983e7e5e267955ee2f1c871e04d427ff02666a94f41f5d51d78f9f644"} Jul 09 16:56:05.718399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.718371 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:05.742337 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.742299 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7418-140524472245104_8c5b62c1-b639-47cd-a2c7-825c7c4c459c/test-curl-7418-140524472245104/0.log" Jul 09 16:56:05.762644 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.762611 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4j4g\" (UniqueName: \"kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g\") pod \"8c5b62c1-b639-47cd-a2c7-825c7c4c459c\" (UID: \"8c5b62c1-b639-47cd-a2c7-825c7c4c459c\") " Jul 09 16:56:05.764746 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.764718 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g" (OuterVolumeSpecName: "kube-api-access-d4j4g") pod "8c5b62c1-b639-47cd-a2c7-825c7c4c459c" (UID: "8c5b62c1-b639-47cd-a2c7-825c7c4c459c"). InnerVolumeSpecName "kube-api-access-d4j4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:56:05.768741 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.768717 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:05.772579 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.772559 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7418-140524472245104"] Jul 09 16:56:05.863858 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:05.863730 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4j4g\" (UniqueName: \"kubernetes.io/projected/8c5b62c1-b639-47cd-a2c7-825c7c4c459c-kube-api-access-d4j4g\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jul 09 16:56:06.107094 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.107007 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:06.135707 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.135633 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" path="/var/lib/kubelet/pods/8c5b62c1-b639-47cd-a2c7-825c7c4c459c/volumes" Jul 09 16:56:06.556560 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.556525 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:06.583532 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.583504 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7418-140524472245104" Jul 09 16:56:06.583702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.583510 2571 scope.go:117] "RemoveContainer" containerID="526f1fd983e7e5e267955ee2f1c871e04d427ff02666a94f41f5d51d78f9f644" Jul 09 16:56:06.657298 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.657267 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:06.757645 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.757519 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:06.900954 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:06.900856 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:10.589686 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:10.589657 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:56:12.575224 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:12.575155 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:12.675715 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:12.675671 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:12.848017 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:12.847933 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:13.079047 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:13.079012 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:13.248298 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:13.248257 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:13.654793 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:13.654687 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:13.788729 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:13.788686 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:14.195696 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:14.195664 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:14.295468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:14.295411 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:19.498521 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:19.498487 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:19.567135 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:19.567095 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:19.754397 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:19.754286 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:19.992676 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:19.992643 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:20.442160 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:20.442127 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fd8f489-xst66_c75394c8-2257-400d-8dca-f051467486e9/authorino/0.log" Jul 09 16:56:23.093084 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:23.093051 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gq87v"] Jul 09 16:56:25.894212 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:25.894172 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qb2gm_91ab878c-645e-45cb-946d-616331b8418f/server/0.log" Jul 09 16:56:26.021406 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:26.021370 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6pmpr_24c96593-3ed3-4722-a1d0-a8ef40b28671/manager/0.log" Jul 09 16:56:26.266468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:26.266417 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7df8c55954-rchc5_94acfd89-9ad9-446d-9068-d7d4d3476940/copy-manifests/0.log" Jul 09 16:56:26.274271 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:26.274232 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7df8c55954-rchc5_94acfd89-9ad9-446d-9068-d7d4d3476940/manager/0.log" Jul 09 16:56:27.632870 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.632838 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/pull/0.log" Jul 09 16:56:27.640591 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.640561 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/extract/0.log" Jul 09 16:56:27.648651 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.648616 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/util/0.log" Jul 09 16:56:27.765513 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.765480 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/util/0.log" Jul 09 16:56:27.773330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.773300 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/pull/0.log" Jul 09 16:56:27.779682 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.779659 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/extract/0.log" Jul 09 16:56:27.898959 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.898869 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/util/0.log" Jul 09 16:56:27.906290 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.906267 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/pull/0.log" Jul 09 16:56:27.913058 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:27.913036 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/extract/0.log" Jul 09 16:56:28.028036 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.028001 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/util/0.log" Jul 09 16:56:28.035508 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.035487 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/pull/0.log" Jul 09 16:56:28.042475 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.042454 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/extract/0.log" Jul 09 16:56:28.170252 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.170215 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fd8f489-xst66_c75394c8-2257-400d-8dca-f051467486e9/authorino/0.log" Jul 09 16:56:28.510464 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.510353 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-86j68_9e2a5fc2-1dc5-49c6-b76f-74a1640a7785/kuadrant-console-plugin/0.log" Jul 09 16:56:28.868711 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:28.868621 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gq87v_f04b8bc1-7bc7-4c81-8a65-fdea3f025841/limitador/0.log" Jul 09 16:56:29.700063 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:29.700033 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d9878b65-sf5p5_431d5864-0d6b-40db-8e05-f8317103463a/kube-auth-proxy/0.log" Jul 09 16:56:30.783478 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:30.783444 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tcd2w_e4b20be8-5350-4058-9631-e52062b48d9e/main/0.log" Jul 09 16:56:34.793894 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.793860 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7vxd/must-gather-wlck5"] Jul 09 16:56:34.794264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.794205 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" containerName="test-curl-7418-140524472245104" Jul 09 16:56:34.794264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.794215 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" containerName="test-curl-7418-140524472245104" Jul 09 16:56:34.794336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.794286 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c5b62c1-b639-47cd-a2c7-825c7c4c459c" containerName="test-curl-7418-140524472245104" Jul 09 16:56:34.798702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.798682 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:34.801468 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.801449 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7vxd\"/\"kube-root-ca.crt\"" Jul 09 16:56:34.801595 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.801476 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7vxd\"/\"openshift-service-ca.crt\"" Jul 09 16:56:34.801595 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.801450 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b7vxd\"/\"default-dockercfg-w4l5d\"" Jul 09 16:56:34.809210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.809190 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7vxd/must-gather-wlck5"] Jul 09 16:56:34.874321 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.874288 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:34.928100 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.928060 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjzls\" (UniqueName: \"kubernetes.io/projected/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-kube-api-access-mjzls\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:34.928287 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.928121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-must-gather-output\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:34.974086 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:34.974053 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" limit=1024 Jul 09 16:56:35.029269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.029234 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjzls\" (UniqueName: \"kubernetes.io/projected/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-kube-api-access-mjzls\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:35.029269 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.029284 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-must-gather-output\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:35.029609 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.029592 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-must-gather-output\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:35.038678 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.038649 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjzls\" (UniqueName: \"kubernetes.io/projected/97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0-kube-api-access-mjzls\") pod \"must-gather-wlck5\" (UID: \"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0\") " pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:35.108570 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.108481 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7vxd/must-gather-wlck5" Jul 09 16:56:35.244647 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.244619 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7vxd/must-gather-wlck5"] Jul 09 16:56:35.246443 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:56:35.246413 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97f9dbf2_3abb_4ea4_924c_3fb5e2422fe0.slice/crio-fe1125c9883f578d0b098dd1dc95d203545238536c72d19b5f649a6e97fd7757 WatchSource:0}: Error finding container fe1125c9883f578d0b098dd1dc95d203545238536c72d19b5f649a6e97fd7757: Status 404 returned error can't find the container with id fe1125c9883f578d0b098dd1dc95d203545238536c72d19b5f649a6e97fd7757 Jul 09 16:56:35.743297 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:35.743262 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7vxd/must-gather-wlck5" event={"ID":"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0","Type":"ContainerStarted","Data":"fe1125c9883f578d0b098dd1dc95d203545238536c72d19b5f649a6e97fd7757"} Jul 09 16:56:36.754830 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:36.754763 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7vxd/must-gather-wlck5" event={"ID":"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0","Type":"ContainerStarted","Data":"f787a9d2db02e5eccdd51ab64f6f50c725d6866beaf9efdaeb16111adab455c9"} Jul 09 16:56:36.755319 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:36.754847 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7vxd/must-gather-wlck5" event={"ID":"97f9dbf2-3abb-4ea4-924c-3fb5e2422fe0","Type":"ContainerStarted","Data":"67460d11c221e541af72a7d10628828e5e7e01a2659bb28594a5b886ab55dc1f"} Jul 09 16:56:36.775663 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:36.774673 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7vxd/must-gather-wlck5" podStartSLOduration=1.667974831 podStartE2EDuration="2.774653893s" totalImagesPullingTime="1.106679062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:36.770811518 +0000 UTC m=+2451.159293907" watchObservedRunningTime="2026-07-09 16:56:36.774653893 +0000 UTC m=+2451.163136284" Jul 09 16:56:38.038090 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:38.038051 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-spkts_149f66fa-fa61-4a94-9440-52f6822c33df/global-pull-secret-syncer/0.log" Jul 09 16:56:38.096297 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:38.096252 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v5bhs_307e2060-d541-49aa-a1ae-47566c68300e/konnectivity-agent/0.log" Jul 09 16:56:38.216546 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:38.216517 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-93.ec2.internal_a5e421a41c11e9140343823d9a1fa9d3/haproxy/0.log" Jul 09 16:56:42.376005 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.375970 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/extract/0.log" Jul 09 16:56:42.402874 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.402839 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/util/0.log" Jul 09 16:56:42.438818 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.438789 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j622v_3d8a8a72-af5d-4396-a254-1d3c50cb0733/pull/0.log" Jul 09 16:56:42.471436 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.471404 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/extract/0.log" Jul 09 16:56:42.495688 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.495654 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/util/0.log" Jul 09 16:56:42.520525 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.520490 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gb6hk_90f57182-eb02-45c3-9344-8b792de09a67/pull/0.log" Jul 09 16:56:42.554558 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.554527 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/extract/0.log" Jul 09 16:56:42.582325 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.582230 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/util/0.log" Jul 09 16:56:42.609414 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.609376 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rsdbl_21b52d32-fbf3-4546-b264-3ffe9bde14f0/pull/0.log" Jul 09 16:56:42.651720 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.651637 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/extract/0.log" Jul 09 16:56:42.677257 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.677231 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/util/0.log" Jul 09 16:56:42.704121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:42.704074 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef19sjzw_9bc987cc-750c-468e-9066-5655471cecc7/pull/0.log" Jul 09 16:56:43.188264 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:43.188055 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fd8f489-xst66_c75394c8-2257-400d-8dca-f051467486e9/authorino/0.log" Jul 09 16:56:43.270584 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:43.270556 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-86j68_9e2a5fc2-1dc5-49c6-b76f-74a1640a7785/kuadrant-console-plugin/0.log" Jul 09 16:56:43.452696 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:43.452613 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gq87v_f04b8bc1-7bc7-4c81-8a65-fdea3f025841/limitador/0.log" Jul 09 16:56:45.075758 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.075728 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/alertmanager/0.log" Jul 09 16:56:45.104659 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.104628 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/config-reloader/0.log" Jul 09 16:56:45.130972 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.130943 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/kube-rbac-proxy-web/0.log" Jul 09 16:56:45.153996 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.153970 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/kube-rbac-proxy/0.log" Jul 09 16:56:45.180717 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.180693 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/kube-rbac-proxy-metric/0.log" Jul 09 16:56:45.203336 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.203308 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/prom-label-proxy/0.log" Jul 09 16:56:45.228998 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.228970 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7b644790-9eab-462f-8c31-c764d5e344f3/init-config-reloader/0.log" Jul 09 16:56:45.425513 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.425486 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55dd8c54b-h694h_3baac756-b1f3-4241-9b9c-ba46b78f9214/metrics-server/0.log" Jul 09 16:56:45.526650 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.526618 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5n6xf_66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3/node-exporter/0.log" Jul 09 16:56:45.554827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.554797 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5n6xf_66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3/kube-rbac-proxy/0.log" Jul 09 16:56:45.586744 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:45.586717 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5n6xf_66fbb18e-ec53-42b5-8cfd-aa5ec4669aa3/init-textfile/0.log" Jul 09 16:56:46.101095 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.101061 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vh7hv_eb1f5bfc-abff-4261-9cdf-bb522cc33316/prometheus-operator/0.log" Jul 09 16:56:46.124742 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.124709 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-vh7hv_eb1f5bfc-abff-4261-9cdf-bb522cc33316/kube-rbac-proxy/0.log" Jul 09 16:56:46.288885 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.288851 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86cfb68547-f9wbr_3707f3f0-ad87-436c-ba06-d3c5d7c976c2/telemeter-client/0.log" Jul 09 16:56:46.327827 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.327710 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86cfb68547-f9wbr_3707f3f0-ad87-436c-ba06-d3c5d7c976c2/reload/0.log" Jul 09 16:56:46.367945 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.367855 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86cfb68547-f9wbr_3707f3f0-ad87-436c-ba06-d3c5d7c976c2/kube-rbac-proxy/0.log" Jul 09 16:56:46.407814 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.407784 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/thanos-query/0.log" Jul 09 16:56:46.437982 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.437936 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/kube-rbac-proxy-web/0.log" Jul 09 16:56:46.467210 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.467179 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/kube-rbac-proxy/0.log" Jul 09 16:56:46.491975 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.491947 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/prom-label-proxy/0.log" Jul 09 16:56:46.521782 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.521741 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/kube-rbac-proxy-rules/0.log" Jul 09 16:56:46.548618 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:46.548579 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76f9f98f6b-96wwj_cecbdea0-e524-49f3-b5f8-79053b25389a/kube-rbac-proxy-metrics/0.log" Jul 09 16:56:47.668458 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.668421 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx"] Jul 09 16:56:47.673358 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.673323 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.681667 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.681624 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx"] Jul 09 16:56:47.758822 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.758718 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-sys\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.758822 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.758804 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-lib-modules\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.759145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.758844 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bcxv\" (UniqueName: \"kubernetes.io/projected/3830f82d-28cd-43be-963d-4886715185c9-kube-api-access-5bcxv\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.759145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.758889 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-podres\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.759145 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.759002 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-proc\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860204 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860164 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-podres\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860283 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-proc\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860340 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-podres\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860341 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-sys\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860399 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860385 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-sys\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860609 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860400 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-lib-modules\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860609 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860430 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-proc\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860609 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860452 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bcxv\" (UniqueName: \"kubernetes.io/projected/3830f82d-28cd-43be-963d-4886715185c9-kube-api-access-5bcxv\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.860609 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.860593 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3830f82d-28cd-43be-963d-4886715185c9-lib-modules\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.873452 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.873400 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bcxv\" (UniqueName: \"kubernetes.io/projected/3830f82d-28cd-43be-963d-4886715185c9-kube-api-access-5bcxv\") pod \"perf-node-gather-daemonset-vtmrx\" (UID: \"3830f82d-28cd-43be-963d-4886715185c9\") " pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:47.993996 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:47.993902 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:48.193123 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.193089 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx"] Jul 09 16:56:48.193451 ip-10-0-139-93 kubenswrapper[2571]: W0709 16:56:48.193427 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3830f82d_28cd_43be_963d_4886715185c9.slice/crio-596e360145b57df41342157b6898b1bfa3f8b7b0393616b5ced7bf48daffdc85 WatchSource:0}: Error finding container 596e360145b57df41342157b6898b1bfa3f8b7b0393616b5ced7bf48daffdc85: Status 404 returned error can't find the container with id 596e360145b57df41342157b6898b1bfa3f8b7b0393616b5ced7bf48daffdc85 Jul 09 16:56:48.860487 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.860441 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" event={"ID":"3830f82d-28cd-43be-963d-4886715185c9","Type":"ContainerStarted","Data":"25d01b8ab6d5115febead5bc05dcba65132c06f5bcc51d264b580d73eba95dbf"} Jul 09 16:56:48.861009 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.860514 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" event={"ID":"3830f82d-28cd-43be-963d-4886715185c9","Type":"ContainerStarted","Data":"596e360145b57df41342157b6898b1bfa3f8b7b0393616b5ced7bf48daffdc85"} Jul 09 16:56:48.861367 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.861328 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:48.878820 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.878723 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" podStartSLOduration=1.8787013190000001 podStartE2EDuration="1.878701319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:48.876807149 +0000 UTC m=+2463.265289537" watchObservedRunningTime="2026-07-09 16:56:48.878701319 +0000 UTC m=+2463.267183710" Jul 09 16:56:48.922220 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.922178 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-655465cb6b-jlmtt_244eacb5-250b-4ca7-b8f1-0403eb8b34cd/console/0.log" Jul 09 16:56:48.962783 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:48.962723 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-85dqc_d295172d-0b96-4338-a07c-1e19f6951bb6/download-server/0.log" Jul 09 16:56:50.570312 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:50.570276 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdg7f_4bfdcb55-5c88-46b4-bd5e-608a761a83f3/dns/0.log" Jul 09 16:56:50.591723 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:50.591694 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bdg7f_4bfdcb55-5c88-46b4-bd5e-608a761a83f3/kube-rbac-proxy/0.log" Jul 09 16:56:50.718040 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:50.718011 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ckrkq_029f25d1-3744-4ecd-b528-1c66cdb8ec63/dns-node-resolver/0.log" Jul 09 16:56:51.353351 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:51.353321 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4jwb6_67812c92-58ea-4e44-b9ba-5efb3f5a005a/node-ca/0.log" Jul 09 16:56:52.493330 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:52.493303 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d9878b65-sf5p5_431d5864-0d6b-40db-8e05-f8317103463a/kube-auth-proxy/0.log" Jul 09 16:56:53.360365 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:53.360335 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-b5cf8_19a5b4c5-c769-40f8-a762-c9cb3aeb847d/serve-healthcheck-canary/0.log" Jul 09 16:56:53.892617 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:53.892585 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wkfn_812e0308-9d43-4026-9331-7c62aa45f6e2/kube-rbac-proxy/0.log" Jul 09 16:56:53.915244 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:53.915202 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wkfn_812e0308-9d43-4026-9331-7c62aa45f6e2/exporter/0.log" Jul 09 16:56:53.939065 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:53.939029 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4wkfn_812e0308-9d43-4026-9331-7c62aa45f6e2/extractor/0.log" Jul 09 16:56:55.889083 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:55.889050 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b7vxd/perf-node-gather-daemonset-vtmrx" Jul 09 16:56:56.415808 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:56.415756 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qb2gm_91ab878c-645e-45cb-946d-616331b8418f/server/0.log" Jul 09 16:56:56.526534 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:56.526498 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6pmpr_24c96593-3ed3-4722-a1d0-a8ef40b28671/manager/0.log" Jul 09 16:56:56.656702 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:56.656672 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7df8c55954-rchc5_94acfd89-9ad9-446d-9068-d7d4d3476940/manager/0.log" Jul 09 16:56:56.677543 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:56.677473 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7df8c55954-rchc5_94acfd89-9ad9-446d-9068-d7d4d3476940/copy-manifests/0.log" Jul 09 16:56:57.992854 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:57.992800 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b747dc9cb-dmgzv_6f5294dd-35d1-4ef4-9a29-6fcf42c0f5dd/manager/0.log" Jul 09 16:56:58.829380 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:56:58.829292 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d9878b65-sf5p5_431d5864-0d6b-40db-8e05-f8317103463a/kube-auth-proxy/0.log" Jul 09 16:57:00.243740 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:00.243630 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59d9878b65-sf5p5_431d5864-0d6b-40db-8e05-f8317103463a/kube-auth-proxy/0.log" Jul 09 16:57:04.799036 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.799007 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/kube-multus-additional-cni-plugins/0.log" Jul 09 16:57:04.820121 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.820080 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/egress-router-binary-copy/0.log" Jul 09 16:57:04.840624 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.840602 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/cni-plugins/0.log" Jul 09 16:57:04.860863 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.860833 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/bond-cni-plugin/0.log" Jul 09 16:57:04.881240 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.881210 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/routeoverride-cni/0.log" Jul 09 16:57:04.901285 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.901262 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/whereabouts-cni-bincopy/0.log" Jul 09 16:57:04.921599 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:04.921572 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5wpt5_247a313f-7192-4269-881f-e1fd23dc2190/whereabouts-cni/0.log" Jul 09 16:57:05.317474 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:05.317441 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tzjs8_44742e7f-8298-4d4a-a2ba-52dcc66210ca/kube-multus/0.log" Jul 09 16:57:05.426568 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:05.426537 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h84qq_59a6b722-697b-48eb-868c-874ce847a050/network-metrics-daemon/0.log" Jul 09 16:57:05.447732 ip-10-0-139-93 kubenswrapper[2571]: I0709 16:57:05.447702 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-h84qq_59a6b722-697b-48eb-868c-874ce847a050/kube-rbac-proxy/0.log"