Jul 31 21:25:48.854333 ip-10-0-140-49 systemd[1]: Starting Kubernetes Kubelet... Jul 31 21:25:49.235459 ip-10-0-140-49 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:49.235459 ip-10-0-140-49 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 21:25:49.235459 ip-10-0-140-49 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:49.235459 ip-10-0-140-49 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 21:25:49.235459 ip-10-0-140-49 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 21:25:49.236470 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.236344 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 21:25:49.241202 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241186 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.241202 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241202 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241206 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241210 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241213 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241215 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241222 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241225 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241227 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241229 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241232 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241235 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241237 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241240 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241243 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241245 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241247 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241250 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241253 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241255 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241258 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.241266 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241260 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241262 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241265 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241267 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241270 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241272 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241275 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241278 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241280 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241283 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241285 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241287 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241289 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241292 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241294 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241297 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241299 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241310 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241313 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.241718 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241316 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241319 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241321 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241323 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241326 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241328 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241331 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241333 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241337 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241339 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241342 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241344 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241347 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241351 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241355 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241360 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241363 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241366 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241369 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241371 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.242195 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241374 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241378 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241380 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241383 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241385 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241387 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241390 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241392 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241394 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241397 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241399 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241407 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241409 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241411 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241414 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241416 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241419 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241421 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241424 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.242693 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241426 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241428 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241431 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241433 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241436 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241438 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241440 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241443 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241446 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241449 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241452 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241454 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241456 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241459 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241461 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241463 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241465 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241468 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241470 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.243154 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.241472 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242153 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242160 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242163 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242168 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242171 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242175 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242178 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242181 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242183 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242186 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242189 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242193 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242196 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242199 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242201 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242204 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242206 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242209 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.243594 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242211 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242216 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242219 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242222 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242224 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242227 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242229 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242232 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242234 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242237 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242241 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242244 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242247 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242250 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242253 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242255 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242258 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242261 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242263 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.244042 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242266 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242269 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242272 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242274 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242277 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242279 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242282 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242285 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242287 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242289 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242292 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242294 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242296 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242298 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242302 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242306 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242308 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242311 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242313 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242316 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.244491 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242318 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242320 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242323 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242325 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242327 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242330 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242332 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242334 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242337 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242339 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242342 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242344 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242347 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242352 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242354 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242357 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242359 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242361 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242363 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.244959 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242366 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242368 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242370 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242373 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242375 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242378 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242381 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242384 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242386 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242389 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242392 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242394 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242397 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242399 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242401 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242404 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242406 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242409 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242411 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242413 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.245564 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242416 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242418 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242759 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242763 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242765 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242769 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242784 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242788 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242791 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242794 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242797 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242800 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242802 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242805 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242808 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242810 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242813 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242815 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242819 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242821 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.246027 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242824 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242826 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242828 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242831 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242834 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242836 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242839 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242841 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242843 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242846 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242848 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242851 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242853 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242856 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242858 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242860 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242863 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242865 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242868 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242870 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.246517 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242873 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242875 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242878 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242881 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242883 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242886 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242888 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242890 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242893 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242895 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242901 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242904 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242907 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242910 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242912 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242918 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242920 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242923 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.246974 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242925 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242928 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242931 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242935 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242937 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242940 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242942 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242944 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242947 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242949 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242952 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242954 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242956 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242959 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242962 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242966 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242968 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242971 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242973 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.247464 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242976 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242978 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242981 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242983 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242986 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242989 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242991 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242994 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242996 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.242999 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243002 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243005 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243007 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243010 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243012 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243016 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243019 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243022 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243025 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243027 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.247904 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243030 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243033 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243036 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243114 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243128 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243133 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243138 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243142 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243147 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243151 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243155 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243158 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243161 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243164 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243168 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243171 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243174 2577 flags.go:64] FLAG: --cgroup-root="" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243177 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243180 2577 flags.go:64] FLAG: --client-ca-file="" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243182 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243185 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243189 2577 flags.go:64] FLAG: --cluster-domain="" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243192 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243195 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 21:25:49.248377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243198 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243201 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243204 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243207 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243210 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243213 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243215 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243218 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243220 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243223 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243226 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243230 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243233 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243235 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243238 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243240 2577 flags.go:64] FLAG: --enable-server="true" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243245 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243249 2577 flags.go:64] FLAG: --event-burst="100" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243252 2577 flags.go:64] FLAG: --event-qps="50" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243254 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243257 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243260 2577 flags.go:64] FLAG: --eviction-hard="" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243263 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243265 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243268 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 21:25:49.248926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243271 2577 flags.go:64] FLAG: --eviction-soft="" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243274 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243277 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243279 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243282 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243285 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243288 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243291 2577 flags.go:64] FLAG: --feature-gates="" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243295 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243297 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243300 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243303 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243306 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243308 2577 flags.go:64] FLAG: --help="false" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243311 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243314 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243316 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243319 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243322 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243325 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243328 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243331 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243333 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 21:25:49.249567 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243337 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243341 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243344 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243346 2577 flags.go:64] FLAG: --kube-reserved="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243349 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243352 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243355 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243358 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243361 2577 flags.go:64] FLAG: --lock-file="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243363 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243366 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243369 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243374 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243377 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243379 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243382 2577 flags.go:64] FLAG: --logging-format="text" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243385 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243388 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243391 2577 flags.go:64] FLAG: --manifest-url="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243394 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243397 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243400 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243404 2577 flags.go:64] FLAG: --max-pods="110" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243407 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243409 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 21:25:49.250143 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243412 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243415 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243418 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243420 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243423 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243430 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243433 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243437 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243440 2577 flags.go:64] FLAG: --pod-cidr="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243449 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243455 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243458 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243461 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243463 2577 flags.go:64] FLAG: --port="10250" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243466 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243469 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee697b2be873cbf2" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243472 2577 flags.go:64] FLAG: --qos-reserved="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243474 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243477 2577 flags.go:64] FLAG: --register-node="true" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243480 2577 flags.go:64] FLAG: --register-with-taints="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243487 2577 flags.go:64] FLAG: --registry-burst="10" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243489 2577 flags.go:64] FLAG: --registry-qps="5" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243492 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243495 2577 flags.go:64] FLAG: --reserved-memory="" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243498 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 21:25:49.250902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243500 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243503 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243506 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243508 2577 flags.go:64] FLAG: --runonce="false" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243511 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243514 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243516 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243519 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243521 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243524 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243527 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243529 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243532 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243534 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243538 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243541 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243544 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243549 2577 flags.go:64] FLAG: --system-cgroups="" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243552 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243557 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243559 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243562 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243567 2577 flags.go:64] FLAG: --tls-min-version="" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243570 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243572 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 21:25:49.251638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243575 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243578 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243580 2577 flags.go:64] FLAG: --v="2" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243584 2577 flags.go:64] FLAG: --version="false" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243590 2577 flags.go:64] FLAG: --vmodule="" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243593 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.243596 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243720 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243724 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243726 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243730 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243733 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243735 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243738 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243740 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243742 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243745 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243747 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243750 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243753 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243755 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.252257 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243760 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243762 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243764 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243767 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243770 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243772 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243775 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243777 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243781 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243783 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243786 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243789 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243791 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243793 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243796 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243798 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243802 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243805 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243808 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243811 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.252756 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243813 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243816 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243818 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243820 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243823 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243825 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243829 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243832 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243834 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243837 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243839 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243841 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243845 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243848 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243850 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243852 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243855 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243858 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243860 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243862 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.253252 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243866 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243868 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243871 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243873 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243875 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243878 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243880 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243882 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243885 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243887 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243889 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243892 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243894 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243896 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243899 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243901 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243903 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243906 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243908 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243910 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.253717 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243912 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243915 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243917 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243921 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243925 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243928 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243931 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243933 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243936 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243939 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243942 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243944 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243949 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243952 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243954 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243957 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243959 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243962 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243964 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.254210 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243966 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243969 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243972 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243974 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243977 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.243979 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.244541 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.251908 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.251923 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.252677 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.252688 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252742 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252747 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252750 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.254637 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252754 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252758 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252762 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252764 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252767 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252770 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252772 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252775 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252778 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252780 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252783 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252785 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252788 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252790 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252792 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252795 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252798 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252800 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252803 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.254970 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252805 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252807 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252810 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252812 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252815 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252818 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252821 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252824 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252827 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252829 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252832 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252834 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252837 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252839 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252841 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252844 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252846 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252848 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252851 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252853 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.255433 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252855 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252858 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252860 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252862 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252865 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252867 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252870 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252873 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252875 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252877 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252880 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252882 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252885 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252887 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252889 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252891 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252894 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252896 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252899 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252902 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.255905 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252904 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252907 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252909 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252911 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252914 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252916 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252918 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252920 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252923 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252926 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252928 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252930 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252933 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252935 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252937 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252940 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252942 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252945 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252948 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252951 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.256391 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252953 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252955 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252958 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252960 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252962 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252964 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252967 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252970 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252974 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252976 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252980 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252984 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252986 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252989 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252992 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252994 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.256847 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.252997 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.253001 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253132 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253138 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253141 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253144 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253146 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253148 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253151 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253153 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253156 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253158 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253160 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253164 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253169 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 21:25:49.257246 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253171 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253174 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253176 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253179 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253182 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253184 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253187 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253189 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253191 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253194 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253197 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253200 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253203 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253206 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253209 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253211 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253215 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253217 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253219 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253222 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 21:25:49.257592 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253224 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253226 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253229 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253231 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253233 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253236 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253238 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253240 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253242 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253245 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253247 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253249 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253253 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253255 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253258 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253261 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253263 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253266 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253268 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253271 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 21:25:49.258058 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253273 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253276 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253278 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253281 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253283 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253286 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253288 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253291 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253293 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253295 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253298 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253300 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253303 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253306 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253310 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253312 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253314 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253317 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253319 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253321 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 21:25:49.258620 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253324 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253326 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253329 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253331 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253333 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253336 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253338 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253341 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253343 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253345 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253348 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253350 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253352 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253355 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253357 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253359 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253362 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253365 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253367 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253369 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 21:25:49.259129 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253371 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253374 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253376 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253379 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253382 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:49.253384 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.253389 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.253501 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.255609 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.256829 2577 server.go:1019] "Starting client certificate rotation" Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.256927 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.256956 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 21:25:49.259598 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.258999 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 21:25:49.260829 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.260816 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 21:25:49.272417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.272399 2577 log.go:25] "Validated CRI v1 runtime API" Jul 31 21:25:49.274146 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.274132 2577 log.go:25] "Validated CRI v1 image API" Jul 31 21:25:49.274903 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.274887 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 21:25:49.277216 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.277197 2577 fs.go:135] Filesystem UUIDs: map[165e57a2-cd20-430e-87e3-fbbec554cc4d:/dev/nvme0n1p4 27010124-4e40-4495-a2bd-46c6bd1f68b6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 31 21:25:49.277279 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.277216 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 21:25:49.285178 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.285045 2577 manager.go:216] Machine: {Timestamp:2026-07-31 21:25:49.283713937 +0000 UTC m=+0.318527275 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199785 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2633cbc5a67e36ae8421befdc89f55 SystemUUID:ec2633cb-c5a6-7e36-ae84-21befdc89f55 BootID:e8fff5a4-7cd4-4aa9-acd1-8782618a2f22 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9c:b2:8b:67:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9c:b2:8b:67:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:5d:f6:80:77:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 21:25:49.285178 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.285174 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 21:25:49.285283 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.285242 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 21:25:49.286913 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.286898 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 21:25:49.287919 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.287893 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 21:25:49.288048 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.287921 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 21:25:49.288548 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.288538 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 21:25:49.288581 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.288551 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 21:25:49.288581 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.288557 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 21:25:49.289155 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.289144 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 21:25:49.289836 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.289828 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 21:25:49.292971 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.292960 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 31 21:25:49.293111 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293102 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 21:25:49.293146 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293130 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 31 21:25:49.293146 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293145 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 21:25:49.293199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293178 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 21:25:49.293199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293187 2577 kubelet.go:398] "Adding apiserver pod source" Jul 31 21:25:49.293199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293195 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 21:25:49.293831 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293807 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 21:25:49.293831 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.293831 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 21:25:49.297950 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.297925 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 21:25:49.299347 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.299334 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 21:25:49.299409 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.299362 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 21:25:49.300191 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300177 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 21:25:49.300225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300199 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 21:25:49.300225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300207 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 21:25:49.300225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300212 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 21:25:49.300225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300220 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 21:25:49.300225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300225 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300233 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300241 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300251 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300258 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300267 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 21:25:49.300355 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300272 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 21:25:49.300855 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300845 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 21:25:49.300855 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.300854 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 21:25:49.303131 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.303113 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 21:25:49.304126 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.304111 2577 server.go:1268] "Started kubelet" Jul 31 21:25:49.304320 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.304298 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 21:25:49.304378 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.304335 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 21:25:49.304422 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.304386 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 21:25:49.304910 ip-10-0-140-49 systemd[1]: Started Kubernetes Kubelet. Jul 31 21:25:49.305317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.305300 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 21:25:49.305713 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.305684 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 21:25:49.305713 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.305694 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 21:25:49.307182 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.307166 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 31 21:25:49.308967 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.308942 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 21:25:49.309154 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.309130 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctqdp" Jul 31 21:25:49.309484 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.308709 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-49.ec2.internal.18c77cf06af4061b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-49.ec2.internal,UID:ip-10-0-140-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-49.ec2.internal,},FirstTimestamp:2026-07-31 21:25:49.304063515 +0000 UTC m=+0.338876852,LastTimestamp:2026-07-31 21:25:49.304063515 +0000 UTC m=+0.338876852,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-49.ec2.internal,}" Jul 31 21:25:49.309888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.309876 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 21:25:49.309938 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.309892 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 21:25:49.310034 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.310004 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.310466 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310441 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 21:25:49.310556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310458 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 21:25:49.310556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310511 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 21:25:49.310654 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310641 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 31 21:25:49.310697 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310655 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 31 21:25:49.310754 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310740 2577 factory.go:55] Registering systemd factory Jul 31 21:25:49.310805 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310758 2577 factory.go:223] Registration of the systemd container factory successfully Jul 31 21:25:49.310981 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310964 2577 factory.go:153] Registering CRI-O factory Jul 31 21:25:49.311039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.310984 2577 factory.go:223] Registration of the crio container factory successfully Jul 31 21:25:49.311039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.311029 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 21:25:49.311140 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.311055 2577 factory.go:103] Registering Raw factory Jul 31 21:25:49.311140 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.311090 2577 manager.go:1196] Started watching for new ooms in manager Jul 31 21:25:49.311704 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.311688 2577 manager.go:349] Starting recovery of all containers Jul 31 21:25:49.314716 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.314694 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctqdp" Jul 31 21:25:49.319066 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.319040 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 21:25:49.319205 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.319177 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 21:25:49.321477 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.321455 2577 manager.go:354] Recovery completed Jul 31 21:25:49.331573 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.331463 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 31 21:25:49.334410 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.334399 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.336179 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336160 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.336243 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336190 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.336243 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336201 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.336668 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336653 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 21:25:49.336668 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336667 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 21:25:49.336820 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336681 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 31 21:25:49.336820 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.336694 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.337294 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.337282 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.337336 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.337305 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.337336 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.337315 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.338107 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.338096 2577 policy_none.go:49] "None policy: Start" Jul 31 21:25:49.338147 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.338110 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 21:25:49.338147 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.338120 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 21:25:49.339526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.339515 2577 policy_none.go:47] "Start" Jul 31 21:25:49.377589 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.377576 2577 manager.go:337] "Starting Device Plugin manager" Jul 31 21:25:49.377659 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.377609 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 21:25:49.377659 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.377619 2577 server.go:87] "Starting device plugin registration server" Jul 31 21:25:49.377827 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.377815 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 21:25:49.377881 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.377832 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 21:25:49.378001 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.377984 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 21:25:49.378087 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.378058 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 21:25:49.378087 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.378087 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 21:25:49.378615 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.378592 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 21:25:49.378697 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.378648 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.478558 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.478530 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.480550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.479388 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.480550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.479416 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.480550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.479432 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.480550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.479459 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.487724 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.487670 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 21:25:49.488433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.488420 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.488497 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.488441 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-49.ec2.internal\": node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.488943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.488931 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 21:25:49.488974 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.488963 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 21:25:49.489004 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.488985 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 21:25:49.489053 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.489024 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 21:25:49.491232 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.491209 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:49.534356 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.534334 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.589534 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.589507 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal"] Jul 31 21:25:49.589603 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.589590 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.590652 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.590636 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.590712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.590664 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.590712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.590678 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.592950 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.592938 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.593084 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593055 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.593132 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593114 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.593607 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593580 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.593607 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593591 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.593607 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593609 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.593768 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593616 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.593768 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593631 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.593768 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.593619 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.595844 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.595826 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.595929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.595852 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 21:25:49.596876 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.596861 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientMemory" Jul 31 21:25:49.596949 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.596884 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 21:25:49.596949 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.596894 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeHasSufficientPID" Jul 31 21:25:49.611601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.611581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.611672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.611604 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.611672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.611621 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979a16b3deb9fd23e3efb2e6d72ea3f8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"979a16b3deb9fd23e3efb2e6d72ea3f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.624543 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.624522 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-49.ec2.internal\" not found" node="ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.628689 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.628675 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-49.ec2.internal\" not found" node="ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.634730 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.634717 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.711762 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.711809 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711787 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.711839 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.711839 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1a67e2e6c6dabae907b25b1ebf973d4c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal\" (UID: \"1a67e2e6c6dabae907b25b1ebf973d4c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.711898 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711849 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979a16b3deb9fd23e3efb2e6d72ea3f8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"979a16b3deb9fd23e3efb2e6d72ea3f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.711898 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.711877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/979a16b3deb9fd23e3efb2e6d72ea3f8-config\") pod \"kube-apiserver-proxy-ip-10-0-140-49.ec2.internal\" (UID: \"979a16b3deb9fd23e3efb2e6d72ea3f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.735115 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.735099 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.835849 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.835804 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:49.927280 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.927260 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.932275 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:49.932110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:49.936322 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:49.936310 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.036781 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.036761 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.137229 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.137178 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.237728 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.237705 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.256877 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.256858 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 21:25:50.256993 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.256975 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 21:25:50.320131 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.320102 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 21:20:49 +0000 UTC" deadline="2028-03-20 22:38:20.454541527 +0000 UTC" Jul 31 21:25:50.320131 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.320127 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14353h12m30.134417689s" Jul 31 21:25:50.338155 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.338137 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.438873 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.438801 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.449686 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:50.449657 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a67e2e6c6dabae907b25b1ebf973d4c.slice/crio-17bfeafab0697739d37af28b3ee3640db88023afc8b46f36fad42cce6d153a2e WatchSource:0}: Error finding container 17bfeafab0697739d37af28b3ee3640db88023afc8b46f36fad42cce6d153a2e: Status 404 returned error can't find the container with id 17bfeafab0697739d37af28b3ee3640db88023afc8b46f36fad42cce6d153a2e Jul 31 21:25:50.449890 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:50.449871 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979a16b3deb9fd23e3efb2e6d72ea3f8.slice/crio-ed4cb3795389cf6010fc476df94d5a54af36a38a67644d2bfd15e5c33d8caae5 WatchSource:0}: Error finding container ed4cb3795389cf6010fc476df94d5a54af36a38a67644d2bfd15e5c33d8caae5: Status 404 returned error can't find the container with id ed4cb3795389cf6010fc476df94d5a54af36a38a67644d2bfd15e5c33d8caae5 Jul 31 21:25:50.455668 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.455652 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:25:50.492394 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.492355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" event={"ID":"979a16b3deb9fd23e3efb2e6d72ea3f8","Type":"ContainerStarted","Data":"ed4cb3795389cf6010fc476df94d5a54af36a38a67644d2bfd15e5c33d8caae5"} Jul 31 21:25:50.493303 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.493286 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"1a67e2e6c6dabae907b25b1ebf973d4c","Type":"ContainerStarted","Data":"17bfeafab0697739d37af28b3ee3640db88023afc8b46f36fad42cce6d153a2e"} Jul 31 21:25:50.539796 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.539766 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.640205 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:50.640180 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-49.ec2.internal\" not found" Jul 31 21:25:50.686170 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.686154 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:50.700433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.700379 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:50.710777 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.710763 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" Jul 31 21:25:50.721083 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.721059 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 21:25:50.722916 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.722905 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" Jul 31 21:25:50.730867 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.730853 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 21:25:50.811922 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:50.811902 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:51.294573 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.294532 2577 apiserver.go:52] "Watching apiserver" Jul 31 21:25:51.310805 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.310771 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 21:25:51.310985 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.310779 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 21:25:51.312020 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.311981 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vmx9l","openshift-network-diagnostics/network-check-target-lzx6b","openshift-network-operator/iptables-alerter-rfnvq","openshift-cluster-node-tuning-operator/tuned-gf96t","openshift-dns/node-resolver-5t7kr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal","openshift-multus/multus-additional-cni-plugins-hhz2d","openshift-multus/network-metrics-daemon-fdfgj","openshift-ovn-kubernetes/ovnkube-node-pjjph","kube-system/global-pull-secret-syncer-czpdq","kube-system/konnectivity-agent-gnx74","kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll","openshift-image-registry/node-ca-nv8mg"] Jul 31 21:25:51.314794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.314768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.317062 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317035 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.317062 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317058 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.317310 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.317402 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317344 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 21:25:51.317591 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317577 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sjxls\"" Jul 31 21:25:51.317749 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317733 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 21:25:51.317819 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.317761 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 21:25:51.319137 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.319114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.319579 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.319558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2q58q\"" Jul 31 21:25:51.320288 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.319882 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.320288 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.320179 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 21:25:51.321311 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.320971 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.321761 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.321739 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 21:25:51.322729 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.322710 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9mhnf\"" Jul 31 21:25:51.322872 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.322854 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.323178 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.323154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.323278 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.323184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.323278 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.323198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 21:25:51.325175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.325076 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.325175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.325102 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qp955\"" Jul 31 21:25:51.325322 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.325301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.326641 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.326621 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.328276 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.328249 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.329739 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.329483 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r8t46\"" Jul 31 21:25:51.329739 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.329492 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.329739 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.329637 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.330116 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.330098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.330363 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.330346 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 21:25:51.330441 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.330368 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fkrbs\"" Jul 31 21:25:51.330500 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.330468 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.331166 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.331146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.333163 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.333129 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 21:25:51.333490 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.333468 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 21:25:51.333802 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.333784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-65f5s\"" Jul 31 21:25:51.334399 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.333970 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 21:25:51.334399 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.334143 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 21:25:51.334399 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.334205 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.334399 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.334364 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 21:25:51.335047 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.335009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 21:25:51.336051 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.336032 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 21:25:51.336363 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.336342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:51.336489 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.336435 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:25:51.336678 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.336659 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gb9sx\"" Jul 31 21:25:51.338900 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.338880 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.339286 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.339245 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:25:51.343480 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.343456 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.345608 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.345585 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 21:25:51.346023 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.346007 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-62nnq\"" Jul 31 21:25:51.346493 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.346473 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 21:25:51.347752 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.347733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.347855 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.347814 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:25:51.351642 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.351623 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9hg2" Jul 31 21:25:51.359083 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.359059 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j9hg2" Jul 31 21:25:51.411668 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.411585 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-tuned\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-kubelet\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421650 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80f16713-2982-4741-ad92-514dfce65664-iptables-alerter-script\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-multus-certs\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-konnectivity-ca\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421803 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-sys-fs\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmth\" (UniqueName: \"kubernetes.io/projected/254bd7db-b544-4da3-98dd-7b43d6b92368-kube-api-access-lsmth\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421850 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-etc-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-socket-dir-parent\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421934 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwpm\" (UniqueName: \"kubernetes.io/projected/8bae9852-e9ac-4f35-8756-55bb02bb6208-kube-api-access-nxwpm\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421962 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-tmp\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.422611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.421986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-conf-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422014 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-var-lib-kubelet\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-config\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cnibin\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-os-release\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422176 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3107df97-0e95-41e3-b302-4894a421b2ef-serviceca\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-systemd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983f31b7-20cb-419b-a8da-8df93782f855-hosts-file\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f16713-2982-4741-ad92-514dfce65664-host-slash\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-host\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422306 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-var-lib-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-env-overrides\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j958w\" (UniqueName: \"kubernetes.io/projected/983f31b7-20cb-419b-a8da-8df93782f855-kube-api-access-j958w\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.423443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422372 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-bin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-device-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-systemd-units\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422430 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-node-log\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5rnr\" (UniqueName: \"kubernetes.io/projected/6d0639ec-9830-4982-84f9-8f6abff88ca4-kube-api-access-x5rnr\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422529 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-run\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-netd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422612 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79dr8\" (UniqueName: \"kubernetes.io/projected/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-kube-api-access-79dr8\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp5ss\" (UniqueName: \"kubernetes.io/projected/2e72a14a-31c0-4dc7-8e11-f612effff4f9-kube-api-access-qp5ss\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-multus\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-modprobe-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysconfig\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-kubernetes\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424096 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-conf\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422915 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-systemd\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx46m\" (UniqueName: \"kubernetes.io/projected/d141b091-64b4-4bba-8f6c-db951ef832c0-kube-api-access-tx46m\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-bin\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.422991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-ovn\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423024 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-kubelet-config\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnkx\" (UniqueName: \"kubernetes.io/projected/3107df97-0e95-41e3-b302-4894a421b2ef-kube-api-access-fmnkx\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423114 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-system-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423147 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-cnibin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423173 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-hostroot\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423231 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-slash\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423258 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-k8s-cni-cncf-io\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-daemon-config\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423310 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-registration-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-sys\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-dbus\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.424760 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3107df97-0e95-41e3-b302-4894a421b2ef-host\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-os-release\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-cni-binary-copy\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423556 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-netns\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-socket-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423739 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423765 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-kubelet\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-etc-kubernetes\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndtb7\" (UniqueName: \"kubernetes.io/projected/80f16713-2982-4741-ad92-514dfce65664-kube-api-access-ndtb7\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-lib-modules\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423858 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-netns\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423882 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-log-socket\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovn-node-metrics-cert\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.425521 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-script-lib\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.426388 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-agent-certs\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.426388 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.423981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983f31b7-20cb-419b-a8da-8df93782f855-tmp-dir\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.524559 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.524559 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-slash\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-k8s-cni-cncf-io\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-k8s-cni-cncf-io\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-slash\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.524704 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-daemon-config\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-registration-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.524806 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.524798 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:52.024757347 +0000 UTC m=+3.059570696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524827 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-registration-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524830 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-sys\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-dbus\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524884 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-sys\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3107df97-0e95-41e3-b302-4894a421b2ef-host\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-os-release\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-cni-binary-copy\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.524995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-netns\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-socket-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525042 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525083 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-kubelet\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525156 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-etc-kubernetes\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525158 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-os-release\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.525199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndtb7\" (UniqueName: \"kubernetes.io/projected/80f16713-2982-4741-ad92-514dfce65664-kube-api-access-ndtb7\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525209 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3107df97-0e95-41e3-b302-4894a421b2ef-host\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525217 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-netns\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525234 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-lib-modules\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-netns\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-log-socket\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525278 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525317 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovn-node-metrics-cert\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-script-lib\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525365 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-lib-modules\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-agent-certs\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983f31b7-20cb-419b-a8da-8df93782f855-tmp-dir\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525398 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-etc-kubernetes\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-tuned\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-kubelet\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525452 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-dbus\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.526186 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80f16713-2982-4741-ad92-514dfce65664-iptables-alerter-script\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-multus-certs\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525571 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-socket-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525604 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-konnectivity-ca\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-sys-fs\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525682 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmth\" (UniqueName: \"kubernetes.io/projected/254bd7db-b544-4da3-98dd-7b43d6b92368-kube-api-access-lsmth\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525693 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-etc-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525738 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-netns\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-socket-dir-parent\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwpm\" (UniqueName: \"kubernetes.io/projected/8bae9852-e9ac-4f35-8756-55bb02bb6208-kube-api-access-nxwpm\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525781 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525808 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-tmp\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525834 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-conf-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-var-lib-kubelet\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.527021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525893 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-cni-binary-copy\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-config\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cnibin\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525947 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.525975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-os-release\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3107df97-0e95-41e3-b302-4894a421b2ef-serviceca\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526026 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-systemd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526048 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983f31b7-20cb-419b-a8da-8df93782f855-hosts-file\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526086 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f16713-2982-4741-ad92-514dfce65664-host-slash\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526169 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-host\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-var-lib-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-env-overrides\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526246 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526314 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-kubelet\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.528097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j958w\" (UniqueName: \"kubernetes.io/projected/983f31b7-20cb-419b-a8da-8df93782f855-kube-api-access-j958w\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-bin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-device-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-systemd-units\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-node-log\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5rnr\" (UniqueName: \"kubernetes.io/projected/6d0639ec-9830-4982-84f9-8f6abff88ca4-kube-api-access-x5rnr\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-run\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-netd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526714 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79dr8\" (UniqueName: \"kubernetes.io/projected/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-kube-api-access-79dr8\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526739 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp5ss\" (UniqueName: \"kubernetes.io/projected/2e72a14a-31c0-4dc7-8e11-f612effff4f9-kube-api-access-qp5ss\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526772 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-systemd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-multus\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526841 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-conf-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-modprobe-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526893 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-var-lib-kubelet\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysconfig\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526937 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-kubernetes\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526967 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysconfig\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527049 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-os-release\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527094 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-log-socket\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527130 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-cnibin\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-run-multus-certs\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527214 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-bin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-kubelet\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-device-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.526387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/983f31b7-20cb-419b-a8da-8df93782f855-tmp-dir\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-systemd-units\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527444 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-node-log\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-config\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.529902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovnkube-script-lib\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527773 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e72a14a-31c0-4dc7-8e11-f612effff4f9-system-cni-dir\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-host-var-lib-cni-multus\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527879 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-run\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.527918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-netd\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528010 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-modprobe-d\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528041 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-conf\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80f16713-2982-4741-ad92-514dfce65664-iptables-alerter-script\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-systemd\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx46m\" (UniqueName: \"kubernetes.io/projected/d141b091-64b4-4bba-8f6c-db951ef832c0-kube-api-access-tx46m\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528122 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-bin\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528143 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80f16713-2982-4741-ad92-514dfce65664-host-slash\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-ovn\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-kubelet-config\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-sysctl-conf\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528233 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnkx\" (UniqueName: \"kubernetes.io/projected/3107df97-0e95-41e3-b302-4894a421b2ef-kube-api-access-fmnkx\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.528243 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-system-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.530638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528282 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/983f31b7-20cb-419b-a8da-8df93782f855-hosts-file\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.528291 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:52.02827466 +0000 UTC m=+3.063087991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528314 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-cnibin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528319 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-system-cni-dir\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-hostroot\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528364 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-systemd\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528379 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528413 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-run-ovn\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-cnibin\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528422 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3107df97-0e95-41e3-b302-4894a421b2ef-serviceca\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-hostroot\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528456 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-kubelet-config\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-kubernetes\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528547 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-var-lib-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-host-cni-bin\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d141b091-64b4-4bba-8f6c-db951ef832c0-host\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528677 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-etc-openvswitch\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.531298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528836 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528889 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-socket-dir-parent\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.528917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e72a14a-31c0-4dc7-8e11-f612effff4f9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.529062 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/254bd7db-b544-4da3-98dd-7b43d6b92368-sys-fs\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.529104 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-env-overrides\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.529205 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-konnectivity-ca\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.529777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8bae9852-e9ac-4f35-8756-55bb02bb6208-multus-daemon-config\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.530110 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-etc-tuned\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.531999 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.530381 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-ovn-node-metrics-cert\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.532364 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.532010 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d141b091-64b4-4bba-8f6c-db951ef832c0-tmp\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.535835 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.535811 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:51.535835 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.535839 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:51.536351 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.535855 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:51.536351 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:51.535924 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:52.035907191 +0000 UTC m=+3.070720543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:51.537973 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.537946 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j958w\" (UniqueName: \"kubernetes.io/projected/983f31b7-20cb-419b-a8da-8df93782f855-kube-api-access-j958w\") pod \"node-resolver-5t7kr\" (UID: \"983f31b7-20cb-419b-a8da-8df93782f855\") " pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.539376 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.539272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx46m\" (UniqueName: \"kubernetes.io/projected/d141b091-64b4-4bba-8f6c-db951ef832c0-kube-api-access-tx46m\") pod \"tuned-gf96t\" (UID: \"d141b091-64b4-4bba-8f6c-db951ef832c0\") " pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.539681 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.539666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndtb7\" (UniqueName: \"kubernetes.io/projected/80f16713-2982-4741-ad92-514dfce65664-kube-api-access-ndtb7\") pod \"iptables-alerter-rfnvq\" (UID: \"80f16713-2982-4741-ad92-514dfce65664\") " pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.539879 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.539851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5rnr\" (UniqueName: \"kubernetes.io/projected/6d0639ec-9830-4982-84f9-8f6abff88ca4-kube-api-access-x5rnr\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:51.540821 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.540801 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79dr8\" (UniqueName: \"kubernetes.io/projected/a6c1d8e2-ed96-4c31-8c5e-002649aa16fb-kube-api-access-79dr8\") pod \"ovnkube-node-pjjph\" (UID: \"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.540821 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.540820 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwpm\" (UniqueName: \"kubernetes.io/projected/8bae9852-e9ac-4f35-8756-55bb02bb6208-kube-api-access-nxwpm\") pod \"multus-vmx9l\" (UID: \"8bae9852-e9ac-4f35-8756-55bb02bb6208\") " pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.540934 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.540917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01da8896-fa0c-45f0-bdf5-4947dc1a79f7-agent-certs\") pod \"konnectivity-agent-gnx74\" (UID: \"01da8896-fa0c-45f0-bdf5-4947dc1a79f7\") " pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.541281 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.541260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp5ss\" (UniqueName: \"kubernetes.io/projected/2e72a14a-31c0-4dc7-8e11-f612effff4f9-kube-api-access-qp5ss\") pod \"multus-additional-cni-plugins-hhz2d\" (UID: \"2e72a14a-31c0-4dc7-8e11-f612effff4f9\") " pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.541729 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.541710 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnkx\" (UniqueName: \"kubernetes.io/projected/3107df97-0e95-41e3-b302-4894a421b2ef-kube-api-access-fmnkx\") pod \"node-ca-nv8mg\" (UID: \"3107df97-0e95-41e3-b302-4894a421b2ef\") " pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.541817 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.541767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmth\" (UniqueName: \"kubernetes.io/projected/254bd7db-b544-4da3-98dd-7b43d6b92368-kube-api-access-lsmth\") pod \"aws-ebs-csi-driver-node-7fdll\" (UID: \"254bd7db-b544-4da3-98dd-7b43d6b92368\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.629114 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.629022 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" Jul 31 21:25:51.638021 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.638000 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" Jul 31 21:25:51.649090 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.649041 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rfnvq" Jul 31 21:25:51.655274 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.655254 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gf96t" Jul 31 21:25:51.663157 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.663135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t7kr" Jul 31 21:25:51.671031 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.671006 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nv8mg" Jul 31 21:25:51.678053 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.678035 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:25:51.684004 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.683982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vmx9l" Jul 31 21:25:51.689794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.689775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:25:51.713578 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:51.713555 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 21:25:52.032778 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.032695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:52.032944 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.032777 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:52.032944 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.032854 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:52.032944 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.032901 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:52.032944 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.032923 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:53.032903736 +0000 UTC m=+4.067717081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:52.033187 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.032957 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:53.032939534 +0000 UTC m=+4.067752905 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:52.134136 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.134085 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:52.134329 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.134306 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:52.134412 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.134341 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:52.134412 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.134358 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:52.134478 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.134432 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:53.134411855 +0000 UTC m=+4.169225202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:52.363234 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.363136 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:20:51 +0000 UTC" deadline="2028-05-01 13:53:08.125990704 +0000 UTC" Jul 31 21:25:52.363234 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.363173 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15352h27m15.762821375s" Jul 31 21:25:52.453547 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:52.453517 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c1d8e2_ed96_4c31_8c5e_002649aa16fb.slice/crio-3cecd5777072f64e5dc18bc874b52a20e60669bde5910a9eceaa3885ed68b833 WatchSource:0}: Error finding container 3cecd5777072f64e5dc18bc874b52a20e60669bde5910a9eceaa3885ed68b833: Status 404 returned error can't find the container with id 3cecd5777072f64e5dc18bc874b52a20e60669bde5910a9eceaa3885ed68b833 Jul 31 21:25:52.454940 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:52.454914 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01da8896_fa0c_45f0_bdf5_4947dc1a79f7.slice/crio-1199a7318cde406b1cf351567296c6f3ffa20ac82e301b446feed0fecb5369ff WatchSource:0}: Error finding container 1199a7318cde406b1cf351567296c6f3ffa20ac82e301b446feed0fecb5369ff: Status 404 returned error can't find the container with id 1199a7318cde406b1cf351567296c6f3ffa20ac82e301b446feed0fecb5369ff Jul 31 21:25:52.458865 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:52.457143 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod983f31b7_20cb_419b_a8da_8df93782f855.slice/crio-effa52f295d5a20a030fcada06bfa32a1f73e1b3414deec6c6cc0d1644ef42fd WatchSource:0}: Error finding container effa52f295d5a20a030fcada06bfa32a1f73e1b3414deec6c6cc0d1644ef42fd: Status 404 returned error can't find the container with id effa52f295d5a20a030fcada06bfa32a1f73e1b3414deec6c6cc0d1644ef42fd Jul 31 21:25:52.460293 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:52.460265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3107df97_0e95_41e3_b302_4894a421b2ef.slice/crio-5491db912ccf1366dd678cc4a3090cd9114b295411147b956e56cbb25f8ef3b3 WatchSource:0}: Error finding container 5491db912ccf1366dd678cc4a3090cd9114b295411147b956e56cbb25f8ef3b3: Status 404 returned error can't find the container with id 5491db912ccf1366dd678cc4a3090cd9114b295411147b956e56cbb25f8ef3b3 Jul 31 21:25:52.463090 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:25:52.463035 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e72a14a_31c0_4dc7_8e11_f612effff4f9.slice/crio-b2da5618c2b18d2a923ef533493af9a732d3b2784508f562b610203d42b11c90 WatchSource:0}: Error finding container b2da5618c2b18d2a923ef533493af9a732d3b2784508f562b610203d42b11c90: Status 404 returned error can't find the container with id b2da5618c2b18d2a923ef533493af9a732d3b2784508f562b610203d42b11c90 Jul 31 21:25:52.489966 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.489946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:52.490089 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:52.490063 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:25:52.499433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.499292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vmx9l" event={"ID":"8bae9852-e9ac-4f35-8756-55bb02bb6208","Type":"ContainerStarted","Data":"6a66c327d0ef1ecb149c2f3201c6bb7a18f57ca53e16fbc7d761cfeb49b3717b"} Jul 31 21:25:52.505602 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.505575 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gf96t" event={"ID":"d141b091-64b4-4bba-8f6c-db951ef832c0","Type":"ContainerStarted","Data":"f1691fd4b45a0a9c441214bc5a2718682df892a8e844746245825c2ca66333bf"} Jul 31 21:25:52.506712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.506690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" event={"ID":"254bd7db-b544-4da3-98dd-7b43d6b92368","Type":"ContainerStarted","Data":"bd60b79baf4aed2927a406792c21c474131e19f16f58e0ecd53e5d8e66abff7a"} Jul 31 21:25:52.507739 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.507698 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nv8mg" event={"ID":"3107df97-0e95-41e3-b302-4894a421b2ef","Type":"ContainerStarted","Data":"5491db912ccf1366dd678cc4a3090cd9114b295411147b956e56cbb25f8ef3b3"} Jul 31 21:25:52.508868 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.508848 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnx74" event={"ID":"01da8896-fa0c-45f0-bdf5-4947dc1a79f7","Type":"ContainerStarted","Data":"1199a7318cde406b1cf351567296c6f3ffa20ac82e301b446feed0fecb5369ff"} Jul 31 21:25:52.509757 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.509741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfnvq" event={"ID":"80f16713-2982-4741-ad92-514dfce65664","Type":"ContainerStarted","Data":"ee048317d6bf8cd4523f2f87acb8d69a1b3feeaad5ee46d9ea427cae477ed191"} Jul 31 21:25:52.510753 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.510733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerStarted","Data":"b2da5618c2b18d2a923ef533493af9a732d3b2784508f562b610203d42b11c90"} Jul 31 21:25:52.511602 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.511584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t7kr" event={"ID":"983f31b7-20cb-419b-a8da-8df93782f855","Type":"ContainerStarted","Data":"effa52f295d5a20a030fcada06bfa32a1f73e1b3414deec6c6cc0d1644ef42fd"} Jul 31 21:25:52.514137 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:52.514115 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"3cecd5777072f64e5dc18bc874b52a20e60669bde5910a9eceaa3885ed68b833"} Jul 31 21:25:53.040985 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.040901 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:53.040985 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.040978 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:53.041261 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.041132 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:53.041261 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.041193 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:55.041173872 +0000 UTC m=+6.075987218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:53.041606 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.041583 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:53.041672 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.041645 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:55.041628695 +0000 UTC m=+6.076442040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:53.141394 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.141359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:53.141543 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.141513 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:53.141543 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.141536 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:53.141665 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.141550 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:53.141665 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.141605 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:55.141587867 +0000 UTC m=+6.176401197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:53.370381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.370242 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 21:20:51 +0000 UTC" deadline="2028-01-16 03:45:05.269575904 +0000 UTC" Jul 31 21:25:53.370381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.370304 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12798h19m11.899276113s" Jul 31 21:25:53.492579 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.491861 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:53.492579 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.491987 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:25:53.492579 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.492409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:53.492579 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:53.492515 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:25:53.522862 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.522826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" event={"ID":"979a16b3deb9fd23e3efb2e6d72ea3f8","Type":"ContainerStarted","Data":"797c7248fee17741fd1e6ae88daf50446626332bf0694897ca45cbf621bff9f7"} Jul 31 21:25:53.529326 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.529293 2577 generic.go:356] "Generic (PLEG): container finished" podID="1a67e2e6c6dabae907b25b1ebf973d4c" containerID="af7605b201a55a79cd3e2f05850e5a3b8ff734151e5d793a1b77bff07e8f1326" exitCode=0 Jul 31 21:25:53.529441 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.529337 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"1a67e2e6c6dabae907b25b1ebf973d4c","Type":"ContainerDied","Data":"af7605b201a55a79cd3e2f05850e5a3b8ff734151e5d793a1b77bff07e8f1326"} Jul 31 21:25:53.551526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:53.551478 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-49.ec2.internal" podStartSLOduration=3.551458999 podStartE2EDuration="3.551458999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:53.537483907 +0000 UTC m=+4.572297257" watchObservedRunningTime="2026-07-31 21:25:53.551458999 +0000 UTC m=+4.586272366" Jul 31 21:25:54.489745 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:54.489711 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:54.490182 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:54.489844 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:25:54.540763 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:54.540730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" event={"ID":"1a67e2e6c6dabae907b25b1ebf973d4c","Type":"ContainerStarted","Data":"ba416c90f3cf586acc68cc5b9f847a6527bd7e39357974124146d5069341109b"} Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:55.058254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:55.058331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.058446 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.058506 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:59.058487961 +0000 UTC m=+10.093301288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.058597 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:55.058959 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.058631 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:59.058618763 +0000 UTC m=+10.093432091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:55.159530 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:55.159359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:55.159530 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.159501 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:55.159530 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.159522 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:55.159530 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.159533 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:55.159848 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.159594 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:25:59.159576025 +0000 UTC m=+10.194389353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:55.491378 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:55.491307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:55.491813 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.491413 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:25:55.491813 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:55.491685 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:55.491813 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:55.491747 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:25:56.489869 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:56.489411 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:56.489869 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:56.489557 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:25:57.489623 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:57.489597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:57.490034 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:57.489712 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:25:57.491650 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:57.489558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:57.491756 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:57.491733 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:25:58.489684 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:58.489263 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:58.489684 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:58.489389 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:25:59.091954 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:59.091922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:25:59.092111 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:59.091988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:59.092111 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.092102 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:59.092194 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.092102 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:59.092194 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.092167 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:07.092149107 +0000 UTC m=+18.126962446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:25:59.092194 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.092182 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:07.092174288 +0000 UTC m=+18.126987619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:25:59.193213 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:59.193182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:59.193375 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.193336 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:25:59.193375 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.193355 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:25:59.193375 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.193368 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:59.193509 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.193419 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:07.19340171 +0000 UTC m=+18.228215053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:25:59.491807 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:59.491095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:25:59.491807 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.491206 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:25:59.491807 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:25:59.491598 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:25:59.491807 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:25:59.491693 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:00.490237 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:00.489758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:00.490237 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:00.489900 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:01.490188 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:01.490158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:01.490554 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:01.490317 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:01.490554 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:01.490392 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:01.490554 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:01.490488 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:02.490239 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:02.490202 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:02.490667 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:02.490324 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:03.489346 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:03.489317 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:03.489516 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:03.489329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:03.489516 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:03.489443 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:03.489516 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:03.489494 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:04.489319 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:04.489289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:04.489698 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:04.489388 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:05.490487 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:05.489970 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:05.490487 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:05.490115 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:05.490487 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:05.490159 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:05.490487 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:05.490234 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:06.489917 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:06.489888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:06.490176 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:06.490000 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:07.159424 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:07.159389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:07.159858 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:07.159457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:07.159858 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.159542 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:07.159858 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.159558 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:07.159858 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.159603 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:23.159585521 +0000 UTC m=+34.194398867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:07.159858 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.159628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:23.159608994 +0000 UTC m=+34.194422325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:07.260461 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:07.260433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:07.260646 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.260621 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:26:07.260724 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.260649 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:26:07.260724 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.260662 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:07.260724 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.260716 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:23.260696972 +0000 UTC m=+34.295510318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:07.490125 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:07.490033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:07.490273 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.490179 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:07.490273 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:07.490215 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:07.490382 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:07.490295 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:08.489344 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:08.489316 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:08.489743 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:08.489408 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:09.490259 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:09.490228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:09.490696 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:09.490332 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:09.490696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:09.490421 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:09.490696 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:09.490517 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:10.489452 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:10.489418 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:10.489618 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:10.489510 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:11.492417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.492141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:11.492954 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.492141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:11.492954 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:11.492487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:11.492954 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:11.492583 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:11.572977 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.572951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" event={"ID":"254bd7db-b544-4da3-98dd-7b43d6b92368","Type":"ContainerStarted","Data":"231a948a3cbe4b3b1ba5e37b82d98c362805761fe4e5c7d3d23b7bdcc65d9283"} Jul 31 21:26:11.574292 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.574270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nv8mg" event={"ID":"3107df97-0e95-41e3-b302-4894a421b2ef","Type":"ContainerStarted","Data":"806c26fb477b62af3f42a06206e8840bb607b27707e3b0af09873f9db783debb"} Jul 31 21:26:11.575785 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.575764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gnx74" event={"ID":"01da8896-fa0c-45f0-bdf5-4947dc1a79f7","Type":"ContainerStarted","Data":"6a62965323d5b8ee03b41cdb93cfeb710f6627c5020e44cf065263e8b0f1bfd9"} Jul 31 21:26:11.577477 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.577452 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="2dc058e0b6dc6b373ef79ae1f45b40ca352f7d2b91b9905d9b92460a5eb9a2b0" exitCode=0 Jul 31 21:26:11.577575 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.577526 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"2dc058e0b6dc6b373ef79ae1f45b40ca352f7d2b91b9905d9b92460a5eb9a2b0"} Jul 31 21:26:11.578930 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.578908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t7kr" event={"ID":"983f31b7-20cb-419b-a8da-8df93782f855","Type":"ContainerStarted","Data":"d90007a191c84f04325ee3ebb744ac56d2f14e86a03e4566982c220b52e7daaf"} Jul 31 21:26:11.582464 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582431 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"34cf215b335b326c12a6e466fa6f16d57376c483d8da4b3f7bf2674e7e49695a"} Jul 31 21:26:11.582558 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"e0ffabbaf1a9e96aa0ba23d566edb44239ea0e34a490c12dd772a502d24da775"} Jul 31 21:26:11.582612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"d28362d944de2193507bf512fd1c7e67270a06339ca7da47e68b51e4f9e9701b"} Jul 31 21:26:11.582612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"409f9812c681255c923e2d167203435c9d82d7fd63ed7eac4494f6aee9365ec3"} Jul 31 21:26:11.582716 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582649 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"136b1c8114a7126219e50cef4a06fce3ae73e01ae01e6dd5fa0feff6a6cd52fd"} Jul 31 21:26:11.582716 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.582696 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"6051da1b5e919fbbe18f05009327a0e5c061d4ee306146497d13fc7705b26490"} Jul 31 21:26:11.584315 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.584294 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vmx9l" event={"ID":"8bae9852-e9ac-4f35-8756-55bb02bb6208","Type":"ContainerStarted","Data":"890e42fc072fd84d1a9920c096d4d88118da10f9a96bed78984043a24d00eaa4"} Jul 31 21:26:11.586102 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.586022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gf96t" event={"ID":"d141b091-64b4-4bba-8f6c-db951ef832c0","Type":"ContainerStarted","Data":"235cb58a1bc819e5b0ecc8fcb032b5470134c08f55108b7a783aa43a23c976a2"} Jul 31 21:26:11.586372 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.586327 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nv8mg" podStartSLOduration=4.347705342 podStartE2EDuration="22.58631252s" totalImagesPullingTime="18.238607178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:11.586265297 +0000 UTC m=+22.621078643" watchObservedRunningTime="2026-07-31 21:26:11.58631252 +0000 UTC m=+22.621125868" Jul 31 21:26:11.587110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.586709 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-49.ec2.internal" podStartSLOduration=21.586696829 podStartE2EDuration="21.586696829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:25:54.554565443 +0000 UTC m=+5.589378791" watchObservedRunningTime="2026-07-31 21:26:11.586696829 +0000 UTC m=+22.621510175" Jul 31 21:26:11.602486 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.602447 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vmx9l" podStartSLOduration=4.318801901 podStartE2EDuration="22.602434809s" totalImagesPullingTime="18.283632908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:11.601856836 +0000 UTC m=+22.636670185" watchObservedRunningTime="2026-07-31 21:26:11.602434809 +0000 UTC m=+22.637248155" Jul 31 21:26:11.635450 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.635412 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gf96t" podStartSLOduration=4.406044195 podStartE2EDuration="22.635396437s" totalImagesPullingTime="18.229352242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:11.635237667 +0000 UTC m=+22.670051015" watchObservedRunningTime="2026-07-31 21:26:11.635396437 +0000 UTC m=+22.670209784" Jul 31 21:26:11.670370 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.670333 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gnx74" podStartSLOduration=4.431411553 podStartE2EDuration="22.670321062s" totalImagesPullingTime="18.238909509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:11.653748357 +0000 UTC m=+22.688561703" watchObservedRunningTime="2026-07-31 21:26:11.670321062 +0000 UTC m=+22.705134408" Jul 31 21:26:11.670685 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:11.670658 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5t7kr" podStartSLOduration=4.426693249 podStartE2EDuration="22.670650604s" totalImagesPullingTime="18.243957355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:11.670210951 +0000 UTC m=+22.705024297" watchObservedRunningTime="2026-07-31 21:26:11.670650604 +0000 UTC m=+22.705463950" Jul 31 21:26:12.035406 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.035383 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 21:26:12.389611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.389519 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T21:26:12.03540187Z","UUID":"6071b0d5-f8a3-4a8e-8a82-68941b6ae14f","Handler":null,"Name":"","Endpoint":""} Jul 31 21:26:12.390980 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.390962 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 21:26:12.391108 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.390998 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 21:26:12.490091 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.490051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:12.490250 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:12.490178 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:12.590583 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.590538 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" event={"ID":"254bd7db-b544-4da3-98dd-7b43d6b92368","Type":"ContainerStarted","Data":"039c5b5d2398f4cf90a25ebbe8f1350b5e0b7b2dff721b3b257387490d9b4897"} Jul 31 21:26:12.592669 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.592407 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rfnvq" event={"ID":"80f16713-2982-4741-ad92-514dfce65664","Type":"ContainerStarted","Data":"6a876eb016bad05fdc517b032be7bb0fe56c819cfbf1121ddad7292df6dc8e6d"} Jul 31 21:26:12.606961 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:12.606915 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rfnvq" podStartSLOduration=5.37253589 podStartE2EDuration="23.606897653s" totalImagesPullingTime="18.234361763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:12.6060961 +0000 UTC m=+23.640909450" watchObservedRunningTime="2026-07-31 21:26:12.606897653 +0000 UTC m=+23.641711002" Jul 31 21:26:13.489615 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:13.489422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:13.489615 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:13.489423 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:13.489900 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:13.489746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:13.489900 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:13.489778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:13.596248 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:13.596222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" event={"ID":"254bd7db-b544-4da3-98dd-7b43d6b92368","Type":"ContainerStarted","Data":"8742ca7fa960e36a1ab7a9aef859ecfa61e1fd225669655a209fedf29e97607c"} Jul 31 21:26:13.611517 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:13.611482 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fdll" podStartSLOduration=4.272915672 podStartE2EDuration="24.611469225s" totalImagesPullingTime="20.338553553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:13.611400474 +0000 UTC m=+24.646213822" watchObservedRunningTime="2026-07-31 21:26:13.611469225 +0000 UTC m=+24.646282571" Jul 31 21:26:14.489718 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:14.489690 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:14.489909 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:14.489804 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:14.603051 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:14.602498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"a0c9156c96969d58b1eddab775c150e6369e3c5518b6f8bf384a9ac88ea21721"} Jul 31 21:26:14.700156 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:14.700124 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:26:14.700740 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:14.700718 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:26:15.490152 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.490121 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:15.490152 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.490158 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:15.490380 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:15.490248 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:15.490644 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:15.490620 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:15.604129 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.604103 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:26:15.604588 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.604572 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gnx74" Jul 31 21:26:15.690365 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.690339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:15.778891 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:15.778865 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:16.489929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.489775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:16.490064 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:16.489997 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:16.606816 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.606793 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="feacde54bae8748dcdbc824be674a347c9eaa8c6eff4fc7eefa6f60e58052152" exitCode=0 Jul 31 21:26:16.607319 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.606881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"feacde54bae8748dcdbc824be674a347c9eaa8c6eff4fc7eefa6f60e58052152"} Jul 31 21:26:16.610395 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.610374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" event={"ID":"a6c1d8e2-ed96-4c31-8c5e-002649aa16fb","Type":"ContainerStarted","Data":"cc1dffa2ed0352898fae15c6bb52c40f6b404877e41fb7ec29de975c97713170"} Jul 31 21:26:16.610738 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.610691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:16.610914 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.610773 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:16.610914 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.610817 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:16.626223 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.626206 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:16.631417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.631402 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:16.646474 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:16.646441 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" podStartSLOduration=9.336284682 podStartE2EDuration="27.646430708s" totalImagesPullingTime="18.310146026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:16.645962656 +0000 UTC m=+27.680776003" watchObservedRunningTime="2026-07-31 21:26:16.646430708 +0000 UTC m=+27.681244055" Jul 31 21:26:17.492363 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:17.492339 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:17.492715 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:17.492444 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:17.492715 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:17.492501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:17.492715 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:17.492578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:18.026278 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.026093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzx6b"] Jul 31 21:26:18.026693 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.026322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:18.026693 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:18.026412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:18.028920 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.028900 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czpdq"] Jul 31 21:26:18.029036 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.028982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:18.029110 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:18.029054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:18.029499 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.029478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdfgj"] Jul 31 21:26:18.029583 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.029570 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:18.029674 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:18.029657 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:18.616961 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.616932 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="df8a17a55fe4ce695a059d058e388ded1b4ceb0f75462401062def7db7982c8c" exitCode=0 Jul 31 21:26:18.617125 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.617013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"df8a17a55fe4ce695a059d058e388ded1b4ceb0f75462401062def7db7982c8c"} Jul 31 21:26:18.680300 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:18.680281 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:19.208987 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:19.208959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:19.260808 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:19.260784 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:19.492648 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:19.492563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:19.492801 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:19.492665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:19.492801 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:19.492675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:19.492801 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:19.492673 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:19.492801 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:19.492738 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:19.492801 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:19.492790 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:20.358837 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.358813 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:20.456400 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.456370 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:20.605874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.605843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:20.622610 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.622553 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="59222678da4ced7870d4e7a5dc9f55a0873dc7a5d0aa4920aae862a9c410c783" exitCode=0 Jul 31 21:26:20.622610 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.622604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"59222678da4ced7870d4e7a5dc9f55a0873dc7a5d0aa4920aae862a9c410c783"} Jul 31 21:26:20.665795 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:20.665773 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:21.489848 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:21.489818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:21.490433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:21.489820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:21.490433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:21.489947 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:26:21.490433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:21.489820 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:21.490433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:21.490025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lzx6b" podUID="48507a1f-dc25-4394-9fbc-2d9cd8611ca9" Jul 31 21:26:21.490433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:21.490110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czpdq" podUID="0ec78100-b077-4d5f-8ba9-68c8e8543ec9" Jul 31 21:26:21.713910 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:21.713880 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:21.782020 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:21.781948 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:23.185040 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.185004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:23.185533 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.185093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:23.185533 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.185181 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:23.185533 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.185196 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:23.185533 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.185254 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:55.18523526 +0000 UTC m=+66.220048587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 21:26:23.185533 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.185267 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret podName:0ec78100-b077-4d5f-8ba9-68c8e8543ec9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:55.185261707 +0000 UTC m=+66.220075032 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret") pod "global-pull-secret-syncer-czpdq" (UID: "0ec78100-b077-4d5f-8ba9-68c8e8543ec9") : object "kube-system"/"original-pull-secret" not registered Jul 31 21:26:23.286336 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.286306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:23.286461 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.286449 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 21:26:23.286502 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.286464 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 21:26:23.286502 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.286473 2577 projected.go:196] Error preparing data for projected volume kube-api-access-sszmm for pod openshift-network-diagnostics/network-check-target-lzx6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:23.286579 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.286526 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm podName:48507a1f-dc25-4394-9fbc-2d9cd8611ca9 nodeName:}" failed. No retries permitted until 2026-07-31 21:26:55.286507294 +0000 UTC m=+66.321320626 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sszmm" (UniqueName: "kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm") pod "network-check-target-lzx6b" (UID: "48507a1f-dc25-4394-9fbc-2d9cd8611ca9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 21:26:23.339806 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.339784 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-49.ec2.internal" event="NodeReady" Jul 31 21:26:23.339946 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.339922 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 21:26:23.380427 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.380401 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6cj8m"] Jul 31 21:26:23.382933 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.382911 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.383719 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.383699 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2dmlr"] Jul 31 21:26:23.384786 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.384755 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 21:26:23.384888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.384835 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 21:26:23.384888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.384848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxlqr\"" Jul 31 21:26:23.385344 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.385328 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.387001 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.386983 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 21:26:23.387118 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.387098 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 21:26:23.387411 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.387393 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2p6df\"" Jul 31 21:26:23.387502 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.387401 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 21:26:23.392121 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.392101 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6cj8m"] Jul 31 21:26:23.394956 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.394936 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dmlr"] Jul 31 21:26:23.487404 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9a62f7-179b-4d06-bb33-55ddb877309c-tmp-dir\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.487404 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6s98\" (UniqueName: \"kubernetes.io/projected/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-kube-api-access-b6s98\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.487564 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487420 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-cert\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.487564 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.487564 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9gx\" (UniqueName: \"kubernetes.io/projected/dc9a62f7-179b-4d06-bb33-55ddb877309c-kube-api-access-vh9gx\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.487564 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.487554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9a62f7-179b-4d06-bb33-55ddb877309c-config-volume\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.489546 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.489482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:23.489669 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.489651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:23.489929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.489482 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:23.492317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492008 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 21:26:23.492317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492237 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 21:26:23.492317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492249 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 21:26:23.492530 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492484 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nppbx\"" Jul 31 21:26:23.492713 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492693 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 21:26:23.492848 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.492765 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtsm8\"" Jul 31 21:26:23.587820 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.587798 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9a62f7-179b-4d06-bb33-55ddb877309c-tmp-dir\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.587922 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.587857 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6s98\" (UniqueName: \"kubernetes.io/projected/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-kube-api-access-b6s98\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.587922 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.587902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-cert\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.588034 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.587927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.588034 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.587944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9gx\" (UniqueName: \"kubernetes.io/projected/dc9a62f7-179b-4d06-bb33-55ddb877309c-kube-api-access-vh9gx\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.588166 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.588096 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:23.588166 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.588117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9a62f7-179b-4d06-bb33-55ddb877309c-config-volume\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.588166 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.588154 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc9a62f7-179b-4d06-bb33-55ddb877309c-tmp-dir\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.588166 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:23.588164 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:24.088141266 +0000 UTC m=+35.122954610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:23.588740 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.588713 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dc9a62f7-179b-4d06-bb33-55ddb877309c-config-volume\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.592989 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.592866 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-cert\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.597936 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.597918 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9gx\" (UniqueName: \"kubernetes.io/projected/dc9a62f7-179b-4d06-bb33-55ddb877309c-kube-api-access-vh9gx\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:23.598174 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.598156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6s98\" (UniqueName: \"kubernetes.io/projected/7e64472c-1ae0-48a9-a87f-6bc03d6667ba-kube-api-access-b6s98\") pod \"ingress-canary-2dmlr\" (UID: \"7e64472c-1ae0-48a9-a87f-6bc03d6667ba\") " pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:23.701902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:23.701868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2dmlr" Jul 31 21:26:24.091414 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:24.091380 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:24.091576 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:24.091519 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:24.091672 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:24.091597 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:25.091575192 +0000 UTC m=+36.126388522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:24.677102 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:24.676484 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2dmlr"] Jul 31 21:26:24.680916 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:26:24.680894 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e64472c_1ae0_48a9_a87f_6bc03d6667ba.slice/crio-79d0ec150dc2ee2f4ccb70b281e2ee00180797ed56b26553138e044b4228880c WatchSource:0}: Error finding container 79d0ec150dc2ee2f4ccb70b281e2ee00180797ed56b26553138e044b4228880c: Status 404 returned error can't find the container with id 79d0ec150dc2ee2f4ccb70b281e2ee00180797ed56b26553138e044b4228880c Jul 31 21:26:25.100328 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:25.100303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:25.100432 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:25.100420 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:25.100478 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:25.100470 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:27.10045714 +0000 UTC m=+38.135270465 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:25.635227 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:25.635190 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dmlr" event={"ID":"7e64472c-1ae0-48a9-a87f-6bc03d6667ba","Type":"ContainerStarted","Data":"79d0ec150dc2ee2f4ccb70b281e2ee00180797ed56b26553138e044b4228880c"} Jul 31 21:26:25.638260 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:25.638228 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="27cda980df66cdc8e9e4e3410db1ba2fa96a8bc3c34b475e8302d4cbf8a8257a" exitCode=0 Jul 31 21:26:25.638380 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:25.638270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"27cda980df66cdc8e9e4e3410db1ba2fa96a8bc3c34b475e8302d4cbf8a8257a"} Jul 31 21:26:26.646493 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:26.646041 2577 generic.go:356] "Generic (PLEG): container finished" podID="2e72a14a-31c0-4dc7-8e11-f612effff4f9" containerID="2d4e8e03d965190c20aeb845db107936b63a53c60a5161e5b0c2ed65213a40b4" exitCode=0 Jul 31 21:26:26.646888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:26.646273 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerDied","Data":"2d4e8e03d965190c20aeb845db107936b63a53c60a5161e5b0c2ed65213a40b4"} Jul 31 21:26:27.114853 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.114818 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:27.114996 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:27.114931 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:27.114996 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:27.114988 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:31.11497403 +0000 UTC m=+42.149787356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:27.649673 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.649641 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2dmlr" event={"ID":"7e64472c-1ae0-48a9-a87f-6bc03d6667ba","Type":"ContainerStarted","Data":"35369ba83adf720ad220d1862f07de506ea3a545933ff594fd919dc34215bd73"} Jul 31 21:26:27.652817 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.652786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" event={"ID":"2e72a14a-31c0-4dc7-8e11-f612effff4f9","Type":"ContainerStarted","Data":"9ecdb0ee23a64f9579fcc9c446756379a70a5f36ef3bfb3034d89ea96b2ab2c4"} Jul 31 21:26:27.664026 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.663984 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2dmlr" podStartSLOduration=2.5651047350000002 podStartE2EDuration="4.663970753s" totalImagesPullingTime="2.098866018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:27.662903099 +0000 UTC m=+38.697716461" watchObservedRunningTime="2026-07-31 21:26:27.663970753 +0000 UTC m=+38.698784106" Jul 31 21:26:27.682980 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.682938 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hhz2d" podStartSLOduration=10.169641136 podStartE2EDuration="38.682925235s" totalImagesPullingTime="28.513284099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:26:27.68181168 +0000 UTC m=+38.716625027" watchObservedRunningTime="2026-07-31 21:26:27.682925235 +0000 UTC m=+38.717738581" Jul 31 21:26:27.802822 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.802763 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:27.860213 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.860180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:27.944744 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:27.944721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:28.045785 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:28.045756 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:31.139637 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:31.139607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:31.140026 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:31.139699 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:31.140026 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:31.139741 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:39.139730502 +0000 UTC m=+50.174543831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:39.193547 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:39.193510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:39.193971 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:39.193649 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:39.193971 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:39.193713 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:26:55.193697569 +0000 UTC m=+66.228510896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:40.570441 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:40.570409 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:40.671038 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:40.671016 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:41.603286 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:41.603257 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:41.665429 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:41.665400 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:41.719381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:41.719354 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:48.632254 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:48.632227 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjjph" Jul 31 21:26:48.747343 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:48.747316 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:48.848933 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:48.848905 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:48.903767 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:48.903712 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:55.197046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.197010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:26:55.197046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.197047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:26:55.197550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.197093 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:55.197550 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:55.197185 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:26:55.197550 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:55.197265 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:27:27.197247135 +0000 UTC m=+98.232060469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:26:55.199199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.199181 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 21:26:55.199248 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.199200 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 21:26:55.207438 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:55.207416 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 21:26:55.207558 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:26:55.207482 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:27:59.207463561 +0000 UTC m=+130.242276886 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : secret "metrics-daemon-secret" not found Jul 31 21:26:55.211177 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.211156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ec78100-b077-4d5f-8ba9-68c8e8543ec9-original-pull-secret\") pod \"global-pull-secret-syncer-czpdq\" (UID: \"0ec78100-b077-4d5f-8ba9-68c8e8543ec9\") " pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:55.297789 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.297749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:55.299692 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.299677 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 21:26:55.309827 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.309808 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 21:26:55.312225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.312213 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czpdq" Jul 31 21:26:55.320632 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.320604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sszmm\" (UniqueName: \"kubernetes.io/projected/48507a1f-dc25-4394-9fbc-2d9cd8611ca9-kube-api-access-sszmm\") pod \"network-check-target-lzx6b\" (UID: \"48507a1f-dc25-4394-9fbc-2d9cd8611ca9\") " pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:55.330262 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.330241 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:55.382208 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.382183 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:26:55.448987 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.448921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czpdq"] Jul 31 21:26:55.451582 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:26:55.451556 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec78100_b077_4d5f_8ba9_68c8e8543ec9.slice/crio-da81aef8834c4bbcc0d1fddbe2b90ac558458eb82c2a5fda25cb69342db9a960 WatchSource:0}: Error finding container da81aef8834c4bbcc0d1fddbe2b90ac558458eb82c2a5fda25cb69342db9a960: Status 404 returned error can't find the container with id da81aef8834c4bbcc0d1fddbe2b90ac558458eb82c2a5fda25cb69342db9a960 Jul 31 21:26:55.609416 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.609389 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtsm8\"" Jul 31 21:26:55.617841 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.617824 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:26:55.710175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.710116 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czpdq" event={"ID":"0ec78100-b077-4d5f-8ba9-68c8e8543ec9","Type":"ContainerStarted","Data":"da81aef8834c4bbcc0d1fddbe2b90ac558458eb82c2a5fda25cb69342db9a960"} Jul 31 21:26:55.762600 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.762568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lzx6b"] Jul 31 21:26:55.764956 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:26:55.764931 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48507a1f_dc25_4394_9fbc_2d9cd8611ca9.slice/crio-7d6d0903c37a429fc4bbce7c70c8b575d41082d630d89fef164faa4fbdc38fa5 WatchSource:0}: Error finding container 7d6d0903c37a429fc4bbce7c70c8b575d41082d630d89fef164faa4fbdc38fa5: Status 404 returned error can't find the container with id 7d6d0903c37a429fc4bbce7c70c8b575d41082d630d89fef164faa4fbdc38fa5 Jul 31 21:26:55.930183 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.930142 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7"] Jul 31 21:26:55.945301 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.945274 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7"] Jul 31 21:26:55.945422 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.945366 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:55.947525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.947385 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 31 21:26:55.947525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.947409 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 31 21:26:55.947525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.947410 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 31 21:26:55.947754 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.947384 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 31 21:26:55.960832 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.960771 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj"] Jul 31 21:26:55.981203 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.981177 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj"] Jul 31 21:26:55.981310 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.981262 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:55.983417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.983243 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 31 21:26:55.983417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.983397 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 31 21:26:55.983587 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.983462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 31 21:26:55.983656 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:55.983642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 31 21:26:56.003018 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.002997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.003162 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.003162 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmvc\" (UniqueName: \"kubernetes.io/projected/167ca62a-9191-4b24-878c-f7e91ec3c7c9-kube-api-access-6hmvc\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.003270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.003270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81188c53-7c55-489f-a2b2-28a07a4a6a2e-tmp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.003270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003211 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81188c53-7c55-489f-a2b2-28a07a4a6a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.003270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003228 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dtp\" (UniqueName: \"kubernetes.io/projected/81188c53-7c55-489f-a2b2-28a07a4a6a2e-kube-api-access-82dtp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.003270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.003497 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.003272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/167ca62a-9191-4b24-878c-f7e91ec3c7c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104372 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/167ca62a-9191-4b24-878c-f7e91ec3c7c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104471 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmvc\" (UniqueName: \"kubernetes.io/projected/167ca62a-9191-4b24-878c-f7e91ec3c7c9-kube-api-access-6hmvc\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104525 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81188c53-7c55-489f-a2b2-28a07a4a6a2e-tmp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.104550 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81188c53-7c55-489f-a2b2-28a07a4a6a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.104842 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dtp\" (UniqueName: \"kubernetes.io/projected/81188c53-7c55-489f-a2b2-28a07a4a6a2e-kube-api-access-82dtp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.104842 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.104583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.105173 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.105145 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/167ca62a-9191-4b24-878c-f7e91ec3c7c9-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.105468 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.105260 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81188c53-7c55-489f-a2b2-28a07a4a6a2e-tmp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.107560 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.107537 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.108121 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.108066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-ca\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.108222 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.108144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/81188c53-7c55-489f-a2b2-28a07a4a6a2e-klusterlet-config\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.108292 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.108272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-hub\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.108698 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.108674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/167ca62a-9191-4b24-878c-f7e91ec3c7c9-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.112865 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.112848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dtp\" (UniqueName: \"kubernetes.io/projected/81188c53-7c55-489f-a2b2-28a07a4a6a2e-kube-api-access-82dtp\") pod \"klusterlet-addon-workmgr-54bbc8d7dc-mc6h7\" (UID: \"81188c53-7c55-489f-a2b2-28a07a4a6a2e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.112943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.112866 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmvc\" (UniqueName: \"kubernetes.io/projected/167ca62a-9191-4b24-878c-f7e91ec3c7c9-kube-api-access-6hmvc\") pod \"cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj\" (UID: \"167ca62a-9191-4b24-878c-f7e91ec3c7c9\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.255927 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.255671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:26:56.299065 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.299044 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:26:56.427025 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.426411 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7"] Jul 31 21:26:56.428612 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:26:56.428582 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81188c53_7c55_489f_a2b2_28a07a4a6a2e.slice/crio-999b0455cf63bdf70069c20c6e571d5cdbee095d1d28a8701382e3df8bb07295 WatchSource:0}: Error finding container 999b0455cf63bdf70069c20c6e571d5cdbee095d1d28a8701382e3df8bb07295: Status 404 returned error can't find the container with id 999b0455cf63bdf70069c20c6e571d5cdbee095d1d28a8701382e3df8bb07295 Jul 31 21:26:56.475414 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.475381 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj"] Jul 31 21:26:56.478782 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:26:56.478753 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod167ca62a_9191_4b24_878c_f7e91ec3c7c9.slice/crio-3f3b2a3053672e7f69020ba9496160540206adc9390b17d68165f14673338d85 WatchSource:0}: Error finding container 3f3b2a3053672e7f69020ba9496160540206adc9390b17d68165f14673338d85: Status 404 returned error can't find the container with id 3f3b2a3053672e7f69020ba9496160540206adc9390b17d68165f14673338d85 Jul 31 21:26:56.715347 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.715291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerStarted","Data":"3f3b2a3053672e7f69020ba9496160540206adc9390b17d68165f14673338d85"} Jul 31 21:26:56.716777 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.716747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" event={"ID":"81188c53-7c55-489f-a2b2-28a07a4a6a2e","Type":"ContainerStarted","Data":"999b0455cf63bdf70069c20c6e571d5cdbee095d1d28a8701382e3df8bb07295"} Jul 31 21:26:56.718160 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:26:56.718130 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzx6b" event={"ID":"48507a1f-dc25-4394-9fbc-2d9cd8611ca9","Type":"ContainerStarted","Data":"7d6d0903c37a429fc4bbce7c70c8b575d41082d630d89fef164faa4fbdc38fa5"} Jul 31 21:27:04.747228 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.747197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerStarted","Data":"e2a1a2f72aff4cb59bfa222a4d86edd8b42ade3db082d55fefddf3e5b7c100fe"} Jul 31 21:27:04.747616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.747241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerStarted","Data":"a304550ed09804c41ddba89799b779efd0fec4ef0ca19d25be2e663e68f9ba9d"} Jul 31 21:27:04.747616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.747260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerStarted","Data":"4310ea8bbf4d9a2dcb623f7029f5ba0b2321aacd8852027b99971aca0aae6e1d"} Jul 31 21:27:04.748631 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.748605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czpdq" event={"ID":"0ec78100-b077-4d5f-8ba9-68c8e8543ec9","Type":"ContainerStarted","Data":"e6bab9d547b702acc5c1556df66100f9c0a4deefea0acba200e14ddbe2d617bf"} Jul 31 21:27:04.749900 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.749880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" event={"ID":"81188c53-7c55-489f-a2b2-28a07a4a6a2e","Type":"ContainerStarted","Data":"829d31e5163f576070261c3c16c2d345f442453af86881bd31c860c151452fc0"} Jul 31 21:27:04.750067 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.750043 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:27:04.751578 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.751561 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:27:04.751958 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.751941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lzx6b" event={"ID":"48507a1f-dc25-4394-9fbc-2d9cd8611ca9","Type":"ContainerStarted","Data":"e5d6fb0d9772f7a187a153f3b4c0b56410f2d44cf93a64a130bd649d7e65d69b"} Jul 31 21:27:04.752092 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.752054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:27:04.769219 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.767403 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" podStartSLOduration=1.809841289 podStartE2EDuration="9.767387926s" totalImagesPullingTime="7.957546637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:27:04.766715596 +0000 UTC m=+75.801528931" watchObservedRunningTime="2026-07-31 21:27:04.767387926 +0000 UTC m=+75.802201276" Jul 31 21:27:04.781500 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.781460 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-czpdq" podStartSLOduration=66.816749703 podStartE2EDuration="1m15.781446279s" totalImagesPullingTime="8.964696576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:27:04.781397478 +0000 UTC m=+75.816210826" watchObservedRunningTime="2026-07-31 21:27:04.781446279 +0000 UTC m=+75.816259630" Jul 31 21:27:04.794788 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.794751 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lzx6b" podStartSLOduration=67.144761287 podStartE2EDuration="1m15.794740852s" totalImagesPullingTime="8.649979565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:27:04.794037725 +0000 UTC m=+75.828851073" watchObservedRunningTime="2026-07-31 21:27:04.794740852 +0000 UTC m=+75.829554199" Jul 31 21:27:04.806849 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:04.806813 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" podStartSLOduration=1.801698054 podStartE2EDuration="9.806803203s" totalImagesPullingTime="8.005105149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:27:04.806514363 +0000 UTC m=+75.841327708" watchObservedRunningTime="2026-07-31 21:27:04.806803203 +0000 UTC m=+75.841616550" Jul 31 21:27:19.222837 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:19.222729 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:27:27.221607 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:27.221574 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:27:27.222003 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:27:27.221706 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:27:27.222003 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:27:27.221756 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:28:31.221743096 +0000 UTC m=+162.256556420 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:27:35.758213 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:35.758184 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lzx6b" Jul 31 21:27:59.234812 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:27:59.234759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:27:59.235257 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:27:59.234916 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 21:27:59.235257 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:27:59.234984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs podName:6d0639ec-9830-4982-84f9-8f6abff88ca4 nodeName:}" failed. No retries permitted until 2026-07-31 21:30:01.234967652 +0000 UTC m=+252.269780978 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs") pod "network-metrics-daemon-fdfgj" (UID: "6d0639ec-9830-4982-84f9-8f6abff88ca4") : secret "metrics-daemon-secret" not found Jul 31 21:28:26.396823 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:28:26.396774 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6cj8m" podUID="dc9a62f7-179b-4d06-bb33-55ddb877309c" Jul 31 21:28:26.500270 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:28:26.500228 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fdfgj" podUID="6d0639ec-9830-4982-84f9-8f6abff88ca4" Jul 31 21:28:26.978910 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:28:26.978878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:28:31.249172 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:28:31.249142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:28:31.249523 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:28:31.249256 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 21:28:31.249523 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:28:31.249315 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls podName:dc9a62f7-179b-4d06-bb33-55ddb877309c nodeName:}" failed. No retries permitted until 2026-07-31 21:30:33.249302045 +0000 UTC m=+284.284115371 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls") pod "dns-default-6cj8m" (UID: "dc9a62f7-179b-4d06-bb33-55ddb877309c") : secret "dns-default-metrics-tls" not found Jul 31 21:28:41.493040 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:28:41.492968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:29:01.588058 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:01.588028 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:04.750554 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:04.750500 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" podUID="81188c53-7c55-489f-a2b2-28a07a4a6a2e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jul 31 21:29:05.087864 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:05.087837 2577 generic.go:356] "Generic (PLEG): container finished" podID="81188c53-7c55-489f-a2b2-28a07a4a6a2e" containerID="829d31e5163f576070261c3c16c2d345f442453af86881bd31c860c151452fc0" exitCode=1 Jul 31 21:29:05.087996 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:05.087881 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" event={"ID":"81188c53-7c55-489f-a2b2-28a07a4a6a2e","Type":"ContainerDied","Data":"829d31e5163f576070261c3c16c2d345f442453af86881bd31c860c151452fc0"} Jul 31 21:29:05.088181 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:05.088168 2577 scope.go:117] "RemoveContainer" containerID="829d31e5163f576070261c3c16c2d345f442453af86881bd31c860c151452fc0" Jul 31 21:29:06.092363 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:06.092331 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" event={"ID":"81188c53-7c55-489f-a2b2-28a07a4a6a2e","Type":"ContainerStarted","Data":"82003c5e7c7cdf446b2fec668dd4e7c78286b732c3ff651b5a4091653a3794bd"} Jul 31 21:29:06.092759 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:06.092603 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:29:06.093160 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:06.093147 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54bbc8d7dc-mc6h7" Jul 31 21:29:36.499732 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:36.499676 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:36.600708 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:36.600681 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:39.023569 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:39.023536 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:39.129319 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:39.129295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:39.759422 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:39.759397 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:39.871984 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:39.871956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.202525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.202498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.280227 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.280203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.482631 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.482551 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.577990 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.577961 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.692188 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.692161 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cpp56"] Jul 31 21:29:40.694257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.694239 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.696013 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.695994 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 21:29:40.696829 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.696812 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 21:29:40.696920 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.696813 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 21:29:40.697129 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.697114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 21:29:40.697551 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.697535 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bdrnr\"" Jul 31 21:29:40.698097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.698057 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.714945 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.714925 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpp56"] Jul 31 21:29:40.795011 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.794908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.795011 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.794959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57477744-559e-4f22-b4ca-0aae08f3e85b-data-volume\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.795011 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.794986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hdb\" (UniqueName: \"kubernetes.io/projected/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-api-access-b5hdb\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.795269 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.795029 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.795269 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.795099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57477744-559e-4f22-b4ca-0aae08f3e85b-crio-socket\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.803209 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.803186 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:40.896152 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896121 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hdb\" (UniqueName: \"kubernetes.io/projected/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-api-access-b5hdb\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896152 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896316 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57477744-559e-4f22-b4ca-0aae08f3e85b-crio-socket\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896316 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896244 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896316 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:40.896268 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:40.896433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:40.896317 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:40.896433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57477744-559e-4f22-b4ca-0aae08f3e85b-crio-socket\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57477744-559e-4f22-b4ca-0aae08f3e85b-data-volume\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.896433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:40.896322 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:41.396306893 +0000 UTC m=+232.431120218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:40.896433 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:40.896410 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:41.396387595 +0000 UTC m=+232.431200926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : configmap "kube-rbac-proxy" not found Jul 31 21:29:40.896612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.896601 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57477744-559e-4f22-b4ca-0aae08f3e85b-data-volume\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.918260 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.918212 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hdb\" (UniqueName: \"kubernetes.io/projected/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-api-access-b5hdb\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:40.925642 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:40.925620 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:41.019579 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:41.019544 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:41.123984 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:41.123956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:41.400828 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:41.400733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:41.400828 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:41.400785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:41.401373 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:41.400876 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:41.401373 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:41.400883 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:41.401373 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:41.400982 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:42.400959414 +0000 UTC m=+233.435772759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : configmap "kube-rbac-proxy" not found Jul 31 21:29:41.401373 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:41.401047 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:42.401034769 +0000 UTC m=+233.435848094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:42.106165 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:42.106130 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:42.206982 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:42.206956 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:42.408228 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:42.408149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:42.408228 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:42.408207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:42.408605 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:42.408269 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:42.408605 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:42.408303 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:42.408605 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:42.408325 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:44.40831309 +0000 UTC m=+235.443126416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : configmap "kube-rbac-proxy" not found Jul 31 21:29:42.408605 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:42.408354 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:44.408341433 +0000 UTC m=+235.443154759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:42.629665 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:42.629641 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t7kr_983f31b7-20cb-419b-a8da-8df93782f855/dns-node-resolver/0.log" Jul 31 21:29:43.331183 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:43.331151 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:43.628840 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:43.628779 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nv8mg_3107df97-0e95-41e3-b302-4894a421b2ef/node-ca/0.log" Jul 31 21:29:44.227541 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:44.227512 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dmlr_7e64472c-1ae0-48a9-a87f-6bc03d6667ba/serve-healthcheck-canary/0.log" Jul 31 21:29:44.424494 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:44.424464 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:44.424673 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:44.424507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:44.424673 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:44.424603 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 21:29:44.424673 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:44.424669 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:48.424650765 +0000 UTC m=+239.459464096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : configmap "kube-rbac-proxy" not found Jul 31 21:29:44.424894 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:44.424604 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:44.424894 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:44.424738 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:48.424728019 +0000 UTC m=+239.459541344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:45.759555 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:45.759529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:45.929895 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:45.929867 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:46.028984 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:46.028924 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:46.127761 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:46.127734 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:46.250210 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:46.250189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:46.528695 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:46.528656 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:46.674981 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:46.674949 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:48.425785 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.425750 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:48.450724 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.450694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:48.450834 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.450767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:48.450834 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:48.450826 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 21:29:48.450936 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:29:48.450877 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls podName:57477744-559e-4f22-b4ca-0aae08f3e85b nodeName:}" failed. No retries permitted until 2026-07-31 21:29:56.450864169 +0000 UTC m=+247.485677494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cpp56" (UID: "57477744-559e-4f22-b4ca-0aae08f3e85b") : secret "insights-runtime-extractor-tls" not found Jul 31 21:29:48.451285 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.451266 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57477744-559e-4f22-b4ca-0aae08f3e85b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:48.710441 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.710393 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:48.849606 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:48.849583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:49.263347 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:49.263293 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:49.408484 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:49.408461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:49.725728 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:49.725703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:49.841814 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:49.841789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:49.940582 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:49.940561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:50.242416 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:50.242395 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:50.353195 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:50.353174 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:50.905661 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:50.905629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:51.490252 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:51.490223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:51.667575 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:51.667533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:51.906254 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:51.906223 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:52.119308 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:52.119279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:52.282752 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:52.282679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:52.886600 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:52.886573 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:53.302292 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:53.302219 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:53.676209 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:53.676180 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:53.873679 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:53.873652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:54.280656 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:54.280626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:55.081050 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:55.081021 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:55.288831 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:55.288803 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:55.481733 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:55.481673 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:55.908514 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:55.908488 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:56.278183 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.278127 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:56.502880 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.502856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:56.504990 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.504966 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57477744-559e-4f22-b4ca-0aae08f3e85b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cpp56\" (UID: \"57477744-559e-4f22-b4ca-0aae08f3e85b\") " pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:56.522629 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.522608 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:29:56.605127 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.605109 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bdrnr\"" Jul 31 21:29:56.612792 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.612764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cpp56" Jul 31 21:29:56.741162 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:56.741136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cpp56"] Jul 31 21:29:56.743320 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:29:56.743299 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57477744_559e_4f22_b4ca_0aae08f3e85b.slice/crio-de602fd7e9492491ecacc801107d077a50db5fd4476891d111ee0b7e2ac16b31 WatchSource:0}: Error finding container de602fd7e9492491ecacc801107d077a50db5fd4476891d111ee0b7e2ac16b31: Status 404 returned error can't find the container with id de602fd7e9492491ecacc801107d077a50db5fd4476891d111ee0b7e2ac16b31 Jul 31 21:29:57.232343 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:57.232313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpp56" event={"ID":"57477744-559e-4f22-b4ca-0aae08f3e85b","Type":"ContainerStarted","Data":"215da6ff766d3bb627c6b3eb41ff2b87023e837aeb9ce2d015489a7c3c52f159"} Jul 31 21:29:57.232504 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:57.232374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpp56" event={"ID":"57477744-559e-4f22-b4ca-0aae08f3e85b","Type":"ContainerStarted","Data":"de602fd7e9492491ecacc801107d077a50db5fd4476891d111ee0b7e2ac16b31"} Jul 31 21:29:58.237229 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:58.237194 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpp56" event={"ID":"57477744-559e-4f22-b4ca-0aae08f3e85b","Type":"ContainerStarted","Data":"9b02be273c77c5b1e528cd573d5fc9d4b7548c3e8263db1bac71e449e4e7c561"} Jul 31 21:29:59.242492 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:59.242454 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cpp56" event={"ID":"57477744-559e-4f22-b4ca-0aae08f3e85b","Type":"ContainerStarted","Data":"d349282fb03620fa1b784c776cd88edefa841902e6e443e3acee6de2f62b91d4"} Jul 31 21:29:59.260996 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:59.260945 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cpp56" podStartSLOduration=17.525585605 podStartE2EDuration="19.260930193s" totalImagesPullingTime="1.735344588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 21:29:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:29:59.259594817 +0000 UTC m=+250.294408163" watchObservedRunningTime="2026-07-31 21:29:59.260930193 +0000 UTC m=+250.295743540" Jul 31 21:29:59.671240 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:29:59.671208 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:01.335085 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:01.335039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:30:01.337340 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:01.337317 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d0639ec-9830-4982-84f9-8f6abff88ca4-metrics-certs\") pod \"network-metrics-daemon-fdfgj\" (UID: \"6d0639ec-9830-4982-84f9-8f6abff88ca4\") " pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:30:01.596337 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:01.596280 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nppbx\"" Jul 31 21:30:01.604127 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:01.604109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdfgj" Jul 31 21:30:01.724105 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:01.724048 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdfgj"] Jul 31 21:30:01.727764 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:30:01.727741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0639ec_9830_4982_84f9_8f6abff88ca4.slice/crio-7f030988ef1fe4f38e454d49ed54d30b4b7a1efa92633ffe020ba0c681a9903d WatchSource:0}: Error finding container 7f030988ef1fe4f38e454d49ed54d30b4b7a1efa92633ffe020ba0c681a9903d: Status 404 returned error can't find the container with id 7f030988ef1fe4f38e454d49ed54d30b4b7a1efa92633ffe020ba0c681a9903d Jul 31 21:30:02.254894 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:02.254865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfgj" event={"ID":"6d0639ec-9830-4982-84f9-8f6abff88ca4","Type":"ContainerStarted","Data":"7f030988ef1fe4f38e454d49ed54d30b4b7a1efa92633ffe020ba0c681a9903d"} Jul 31 21:30:03.258947 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:03.258917 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfgj" event={"ID":"6d0639ec-9830-4982-84f9-8f6abff88ca4","Type":"ContainerStarted","Data":"5fe183b17863c2af5354a5826574b020357cb8d173f7cfa7caa147b510676d0a"} Jul 31 21:30:03.259375 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:03.258964 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdfgj" event={"ID":"6d0639ec-9830-4982-84f9-8f6abff88ca4","Type":"ContainerStarted","Data":"6cfea506e57337276ec427d259f6ee0f2ca7bd3bafd0ef40c696701bbdfe257d"} Jul 31 21:30:04.223781 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:04.223752 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:04.304235 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:04.304210 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:06.419233 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.419185 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdfgj" podStartSLOduration=256.53096635 podStartE2EDuration="4m17.41916972s" totalImagesPullingTime="888.20337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:03.280340653 +0000 UTC m=+254.315154002" watchObservedRunningTime="2026-07-31 21:30:06.41916972 +0000 UTC m=+257.453983045" Jul 31 21:30:06.420110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.420087 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c5b46758-d44vj"] Jul 31 21:30:06.421779 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.421767 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.433030 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.433010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 21:30:06.433148 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.433063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtvng\"" Jul 31 21:30:06.433268 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.433253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 21:30:06.438114 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.438100 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 21:30:06.470113 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.470090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 21:30:06.483987 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.483956 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b46758-d44vj"] Jul 31 21:30:06.521191 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.521169 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:06.567764 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567740 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-566w9\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-kube-api-access-566w9\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567840 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a79fd068-499f-4b96-b4ea-724836ae3c45-ca-trust-extracted\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567840 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-bound-sa-token\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567840 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-image-registry-private-configuration\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567932 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-installation-pull-secrets\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567932 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-trusted-ca\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567932 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-tls\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.567932 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.567908 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-certificates\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.622615 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.622583 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:06.669010 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.668985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-tls\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669129 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-certificates\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669129 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-566w9\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-kube-api-access-566w9\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669213 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669173 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a79fd068-499f-4b96-b4ea-724836ae3c45-ca-trust-extracted\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669289 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669220 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-bound-sa-token\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669289 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-image-registry-private-configuration\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669410 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-installation-pull-secrets\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669469 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-trusted-ca\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669613 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669591 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a79fd068-499f-4b96-b4ea-724836ae3c45-ca-trust-extracted\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.669932 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.669908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-certificates\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.670404 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.670387 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a79fd068-499f-4b96-b4ea-724836ae3c45-trusted-ca\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.671392 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.671364 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-registry-tls\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.672068 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.672037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-installation-pull-secrets\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.672208 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.672189 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a79fd068-499f-4b96-b4ea-724836ae3c45-image-registry-private-configuration\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.678946 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.678929 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-566w9\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-kube-api-access-566w9\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.679111 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.679095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a79fd068-499f-4b96-b4ea-724836ae3c45-bound-sa-token\") pod \"image-registry-5c5b46758-d44vj\" (UID: \"a79fd068-499f-4b96-b4ea-724836ae3c45\") " pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.730175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.730154 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:06.732579 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.732564 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:06.855321 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:06.855295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c5b46758-d44vj"] Jul 31 21:30:06.857414 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:30:06.857393 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79fd068_499f_4b96_b4ea_724836ae3c45.slice/crio-a1e9da2ece6a963e423471ff8941a00374b53e66b984ed09602082d86fb822dd WatchSource:0}: Error finding container a1e9da2ece6a963e423471ff8941a00374b53e66b984ed09602082d86fb822dd: Status 404 returned error can't find the container with id a1e9da2ece6a963e423471ff8941a00374b53e66b984ed09602082d86fb822dd Jul 31 21:30:07.272468 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:07.272433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" event={"ID":"a79fd068-499f-4b96-b4ea-724836ae3c45","Type":"ContainerStarted","Data":"905c954918a1983e93908f0b41f0432e5055044b4e603530a9d06642dba3ac80"} Jul 31 21:30:07.272620 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:07.272490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" event={"ID":"a79fd068-499f-4b96-b4ea-724836ae3c45","Type":"ContainerStarted","Data":"a1e9da2ece6a963e423471ff8941a00374b53e66b984ed09602082d86fb822dd"} Jul 31 21:30:07.272620 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:07.272543 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:07.297720 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:07.297683 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podStartSLOduration=1.297669878 podStartE2EDuration="1.297669878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:07.297095184 +0000 UTC m=+258.331908529" watchObservedRunningTime="2026-07-31 21:30:07.297669878 +0000 UTC m=+258.332483223" Jul 31 21:30:10.591601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:10.591535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:10.937950 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:10.937884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:11.139614 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:11.139585 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:14.037859 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:14.037829 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:14.133217 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:14.133194 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:14.234321 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:14.234299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:15.954715 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:15.954690 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.105946 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.105911 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.296504 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.296472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.408341 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.408266 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.423113 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.423092 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bcgjt"] Jul 31 21:30:18.428695 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.428680 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.430458 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.430438 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 21:30:18.430738 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.430724 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 21:30:18.431057 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.431044 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 21:30:18.431274 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.431260 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 21:30:18.431413 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.431395 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 21:30:18.431712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.431696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fkndm\"" Jul 31 21:30:18.431780 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.431702 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 21:30:18.515649 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.515625 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.543381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543472 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543472 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-root\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543472 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-sys\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543472 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-wtmp\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-textfile\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543524 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-metrics-client-ca\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4482j\" (UniqueName: \"kubernetes.io/projected/3ed95dfd-050e-419e-a360-42a5a17fdbce-kube-api-access-4482j\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.543616 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.543594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-tls\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.627688 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.627666 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.644793 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-tls\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.644885 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644804 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.644885 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.644885 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-root\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644904 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-sys\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-wtmp\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-textfile\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-metrics-client-ca\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645009 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-sys\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645041 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.644928 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-root\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645343 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4482j\" (UniqueName: \"kubernetes.io/projected/3ed95dfd-050e-419e-a360-42a5a17fdbce-kube-api-access-4482j\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645343 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-wtmp\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645583 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-textfile\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645661 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645641 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-metrics-client-ca\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.645878 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.645853 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.647131 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.647112 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.647215 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.647203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ed95dfd-050e-419e-a360-42a5a17fdbce-node-exporter-tls\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.658633 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.658579 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4482j\" (UniqueName: \"kubernetes.io/projected/3ed95dfd-050e-419e-a360-42a5a17fdbce-kube-api-access-4482j\") pod \"node-exporter-bcgjt\" (UID: \"3ed95dfd-050e-419e-a360-42a5a17fdbce\") " pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.723437 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.723410 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:18.737572 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.737552 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcgjt" Jul 31 21:30:18.748036 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:30:18.748015 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed95dfd_050e_419e_a360_42a5a17fdbce.slice/crio-1efd45e6fb9c9e2585df8adea4b2bf1edb6be89109ca8948a807170ecc0bd765 WatchSource:0}: Error finding container 1efd45e6fb9c9e2585df8adea4b2bf1edb6be89109ca8948a807170ecc0bd765: Status 404 returned error can't find the container with id 1efd45e6fb9c9e2585df8adea4b2bf1edb6be89109ca8948a807170ecc0bd765 Jul 31 21:30:18.824097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:18.824048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:19.023297 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:19.023235 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:19.309384 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:19.309305 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcgjt" event={"ID":"3ed95dfd-050e-419e-a360-42a5a17fdbce","Type":"ContainerStarted","Data":"1efd45e6fb9c9e2585df8adea4b2bf1edb6be89109ca8948a807170ecc0bd765"} Jul 31 21:30:19.358682 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:19.358652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:19.427612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:19.427578 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:20.282951 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:20.282922 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:20.313207 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:20.313177 2577 generic.go:356] "Generic (PLEG): container finished" podID="3ed95dfd-050e-419e-a360-42a5a17fdbce" containerID="7055e94b7db82ca0d22d3a2eb074ad0615c69679ac95752b70155c6fd53dcce3" exitCode=0 Jul 31 21:30:20.313555 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:20.313230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcgjt" event={"ID":"3ed95dfd-050e-419e-a360-42a5a17fdbce","Type":"ContainerDied","Data":"7055e94b7db82ca0d22d3a2eb074ad0615c69679ac95752b70155c6fd53dcce3"} Jul 31 21:30:21.314870 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.314843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.322164 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.322139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcgjt" event={"ID":"3ed95dfd-050e-419e-a360-42a5a17fdbce","Type":"ContainerStarted","Data":"8fa2aaba9e32c3a39a8f2091b174b9dbb9dec2fbecebe068ee7438668e66276b"} Jul 31 21:30:21.322278 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.322216 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcgjt" event={"ID":"3ed95dfd-050e-419e-a360-42a5a17fdbce","Type":"ContainerStarted","Data":"2f8e41fc26a986f5dccd8ee83990356da70a4cc0088d7f7dff1fc217143647d4"} Jul 31 21:30:21.347518 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.347477 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bcgjt" podStartSLOduration=2.426686971 podStartE2EDuration="3.347464588s" totalImagesPullingTime="853.473911ms" totalInitContainerRuntime="67.303706ms" isStatefulPod=true podCreationTimestamp="2026-07-31 21:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:21.346381129 +0000 UTC m=+272.381194475" watchObservedRunningTime="2026-07-31 21:30:21.347464588 +0000 UTC m=+272.382277933" Jul 31 21:30:21.408580 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.408557 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.512382 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.512364 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.614791 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.614748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.684375 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.684328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.808405 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.808379 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:21.899764 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:21.899713 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:22.204215 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:22.204147 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:22.265245 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:22.265224 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:22.411493 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:22.411467 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:22.601991 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:22.601964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:22.666838 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:22.666821 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.007475 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.007403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.115875 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.115839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.218543 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.218515 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.316677 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.316617 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.662741 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.662721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:23.749800 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:23.749779 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:24.756801 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:24.756778 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:24.956231 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:24.956207 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:25.055353 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:25.055299 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:26.734235 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:26.734207 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:26.734593 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:26.734251 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:28.280309 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:28.280274 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:28.280650 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:28.280326 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:28.456490 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:28.456461 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:28.651413 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:28.651388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:29.979623 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:30:29.979580 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6cj8m" podUID="dc9a62f7-179b-4d06-bb33-55ddb877309c" Jul 31 21:30:30.347263 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:30.347234 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:32.118119 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:32.118090 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:33.345046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:33.345010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:33.347377 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:33.347355 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dc9a62f7-179b-4d06-bb33-55ddb877309c-metrics-tls\") pod \"dns-default-6cj8m\" (UID: \"dc9a62f7-179b-4d06-bb33-55ddb877309c\") " pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:33.351012 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:33.350998 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxlqr\"" Jul 31 21:30:33.358629 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:33.358610 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:33.493822 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:30:33.493795 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9a62f7_179b_4d06_bb33_55ddb877309c.slice/crio-ceacdf9093d6cf55045651b4c20d4fc795ef04dfc4aa8521a7eb1b22b46e0671 WatchSource:0}: Error finding container ceacdf9093d6cf55045651b4c20d4fc795ef04dfc4aa8521a7eb1b22b46e0671: Status 404 returned error can't find the container with id ceacdf9093d6cf55045651b4c20d4fc795ef04dfc4aa8521a7eb1b22b46e0671 Jul 31 21:30:33.493822 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:33.493798 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6cj8m"] Jul 31 21:30:34.251334 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:34.251295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:34.359196 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:34.359164 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cj8m" event={"ID":"dc9a62f7-179b-4d06-bb33-55ddb877309c","Type":"ContainerStarted","Data":"ceacdf9093d6cf55045651b4c20d4fc795ef04dfc4aa8521a7eb1b22b46e0671"} Jul 31 21:30:34.400317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:34.400286 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:35.069092 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.069001 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:35.071390 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.071371 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:30:35.073203 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.073189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.076405 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.076383 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 31 21:30:35.076970 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.076956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5psqq\"" Jul 31 21:30:35.079463 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079438 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 31 21:30:35.079719 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 31 21:30:35.079797 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079720 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 31 21:30:35.079797 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079783 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 31 21:30:35.079916 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079812 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 31 21:30:35.079916 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.079821 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 31 21:30:35.089943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.089927 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:30:35.092620 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.092604 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 31 21:30:35.158198 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158296 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158296 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158296 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbhv8\" (UniqueName: \"kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158400 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158313 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158400 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.158400 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.158363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.186031 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.186010 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:35.258612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258680 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258680 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258635 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbhv8\" (UniqueName: \"kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258680 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258680 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258856 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258695 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.258856 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.258817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.259467 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.259443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.259553 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.259443 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.259553 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.259446 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.259737 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.259718 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.261562 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.261545 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.261665 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.261649 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.267643 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.267619 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbhv8\" (UniqueName: \"kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8\") pod \"console-788d4c69bf-fvmqb\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.363591 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.363570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cj8m" event={"ID":"dc9a62f7-179b-4d06-bb33-55ddb877309c","Type":"ContainerStarted","Data":"d93ac270d0bb127603b5d0b2787323c3dd4ceb9d6e573916178a862d53a9ee3f"} Jul 31 21:30:35.363854 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.363609 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6cj8m" event={"ID":"dc9a62f7-179b-4d06-bb33-55ddb877309c","Type":"ContainerStarted","Data":"691d61ef56adf8bb6fe78b310a1c6d88824e4c672d3ba9431c5bb47178a15fda"} Jul 31 21:30:35.363854 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.363688 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:35.382337 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.382313 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:35.389433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.389397 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6cj8m" podStartSLOduration=251.079176731 podStartE2EDuration="4m12.389385341s" totalImagesPullingTime="1.31020861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:35.389209463 +0000 UTC m=+286.424022811" watchObservedRunningTime="2026-07-31 21:30:35.389385341 +0000 UTC m=+286.424198686" Jul 31 21:30:35.516141 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:35.516122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:30:35.518251 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:30:35.518227 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b56ff9c_b320_4f1e_8248_c8320f8b4ec7.slice/crio-60129075bb8f6f9c93e6fbbeb9125c61bf50a4dfb5f1fd9ae704ced68ad935c7 WatchSource:0}: Error finding container 60129075bb8f6f9c93e6fbbeb9125c61bf50a4dfb5f1fd9ae704ced68ad935c7: Status 404 returned error can't find the container with id 60129075bb8f6f9c93e6fbbeb9125c61bf50a4dfb5f1fd9ae704ced68ad935c7 Jul 31 21:30:36.368780 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:36.368742 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788d4c69bf-fvmqb" event={"ID":"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7","Type":"ContainerStarted","Data":"60129075bb8f6f9c93e6fbbeb9125c61bf50a4dfb5f1fd9ae704ced68ad935c7"} Jul 31 21:30:36.734923 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:36.734842 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:36.734923 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:36.734898 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:38.280056 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:38.280028 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:38.280426 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:38.280103 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:38.377414 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:38.377351 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788d4c69bf-fvmqb" event={"ID":"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7","Type":"ContainerStarted","Data":"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54"} Jul 31 21:30:38.398337 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:38.398293 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-788d4c69bf-fvmqb" podStartSLOduration=0.821293982 podStartE2EDuration="3.398279333s" totalImagesPullingTime="2.576985351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:30:38.397525143 +0000 UTC m=+289.432338492" watchObservedRunningTime="2026-07-31 21:30:38.398279333 +0000 UTC m=+289.433092679" Jul 31 21:30:39.443792 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:39.443757 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:39.507712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:39.507689 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:40.123431 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:40.123394 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:40.191499 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:40.191472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:45.033835 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.033799 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:45.234045 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.234002 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:45.370633 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.370607 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6cj8m" Jul 31 21:30:45.383178 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.383152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:45.383308 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.383196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:45.387842 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.387821 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:45.403566 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:45.403546 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:30:46.734349 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.734319 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:46.734783 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.734379 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:46.734783 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.734424 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:46.734983 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.734950 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"905c954918a1983e93908f0b41f0432e5055044b4e603530a9d06642dba3ac80"} pod="openshift-image-registry/image-registry-5c5b46758-d44vj" containerMessage="Container registry failed liveness probe, will be restarted" Jul 31 21:30:46.738317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.738292 2577 patch_prober.go:28] interesting pod/image-registry-5c5b46758-d44vj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 31 21:30:46.738428 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:46.738345 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 31 21:30:47.276741 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:47.276706 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:47.344492 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:47.344463 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:49.330842 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:49.330820 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 21:30:56.038283 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.038254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:56.094369 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.094347 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:56.291901 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.291833 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:56.300138 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.300104 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" podUID="167ca62a-9191-4b24-878c-f7e91ec3c7c9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 31 21:30:56.393494 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.393471 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:56.509966 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.509947 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/init-textfile/0.log" Jul 31 21:30:56.711145 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.711117 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/node-exporter/0.log" Jul 31 21:30:56.739176 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.739159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:30:56.873624 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.873597 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:56.910223 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.910182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/kube-rbac-proxy/0.log" Jul 31 21:30:56.930677 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:56.930653 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:57.270989 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:57.270964 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:30:57.329757 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:30:57.329732 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:02.847909 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:02.847871 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:02.945900 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:02.945865 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:03.511691 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:03.511662 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-788d4c69bf-fvmqb_4b56ff9c-b320-4f1e-8248-c8320f8b4ec7/console/0.log" Jul 31 21:31:03.911476 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:03.911449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cj8m_dc9a62f7-179b-4d06-bb33-55ddb877309c/dns/0.log" Jul 31 21:31:04.109058 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:04.109032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cj8m_dc9a62f7-179b-4d06-bb33-55ddb877309c/kube-rbac-proxy/0.log" Jul 31 21:31:04.232613 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:04.232549 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:04.332943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:04.332915 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:05.315167 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:05.315142 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t7kr_983f31b7-20cb-419b-a8da-8df93782f855/dns-node-resolver/0.log" Jul 31 21:31:05.910026 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:05.910004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dmlr_7e64472c-1ae0-48a9-a87f-6bc03d6667ba/serve-healthcheck-canary/0.log" Jul 31 21:31:06.300569 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:06.300506 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" podUID="167ca62a-9191-4b24-878c-f7e91ec3c7c9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 31 21:31:06.380667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:06.380637 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:06.454732 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:06.454704 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:11.752264 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:11.752218 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" podUID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerName="registry" containerID="cri-o://905c954918a1983e93908f0b41f0432e5055044b4e603530a9d06642dba3ac80" gracePeriod=30 Jul 31 21:31:13.490436 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.490403 2577 generic.go:356] "Generic (PLEG): container finished" podID="a79fd068-499f-4b96-b4ea-724836ae3c45" containerID="905c954918a1983e93908f0b41f0432e5055044b4e603530a9d06642dba3ac80" exitCode=0 Jul 31 21:31:13.492826 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.492796 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" event={"ID":"a79fd068-499f-4b96-b4ea-724836ae3c45","Type":"ContainerDied","Data":"905c954918a1983e93908f0b41f0432e5055044b4e603530a9d06642dba3ac80"} Jul 31 21:31:13.492945 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.492856 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:31:13.492945 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.492874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" event={"ID":"a79fd068-499f-4b96-b4ea-724836ae3c45","Type":"ContainerStarted","Data":"ab7a708b07c4d87df85dd44b07e16e335cc76cb91efddf9878660a301e8e5457"} Jul 31 21:31:13.758222 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.758155 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:13.848584 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:13.848546 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:14.652874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:14.652843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:14.728092 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:14.728051 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:16.300097 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.300045 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" podUID="167ca62a-9191-4b24-878c-f7e91ec3c7c9" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 31 21:31:16.300524 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.300129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" Jul 31 21:31:16.300563 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.300541 2577 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e2a1a2f72aff4cb59bfa222a4d86edd8b42ade3db082d55fefddf3e5b7c100fe"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 31 21:31:16.300596 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.300574 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" podUID="167ca62a-9191-4b24-878c-f7e91ec3c7c9" containerName="service-proxy" containerID="cri-o://e2a1a2f72aff4cb59bfa222a4d86edd8b42ade3db082d55fefddf3e5b7c100fe" gracePeriod=30 Jul 31 21:31:16.503190 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.503162 2577 generic.go:356] "Generic (PLEG): container finished" podID="167ca62a-9191-4b24-878c-f7e91ec3c7c9" containerID="e2a1a2f72aff4cb59bfa222a4d86edd8b42ade3db082d55fefddf3e5b7c100fe" exitCode=2 Jul 31 21:31:16.503312 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.503248 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerDied","Data":"e2a1a2f72aff4cb59bfa222a4d86edd8b42ade3db082d55fefddf3e5b7c100fe"} Jul 31 21:31:16.503312 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:16.503291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bf58bd8d4-ptwhj" event={"ID":"167ca62a-9191-4b24-878c-f7e91ec3c7c9","Type":"ContainerStarted","Data":"1d248f7cd0dcb9219b158edd2f4ba10d585dbe445bc8f88ecf51d18c90042b66"} Jul 31 21:31:26.582024 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:26.581993 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:26.679574 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:26.679531 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:26.735341 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:26.735320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:34.224134 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.224102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:34.289846 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.289820 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:34.498463 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.498408 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c5b46758-d44vj" Jul 31 21:31:34.508589 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.508567 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:34.609585 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.609561 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:34.673012 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:34.672991 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:38.031220 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:38.031190 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:38.107383 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:38.107358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:49.220311 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:49.220285 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:49.320742 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:49.320721 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:56.621844 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:56.621812 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:31:56.681174 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:31:56.681139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:18.779337 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:18.779307 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:22.369255 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:22.369222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:22.470410 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:22.470384 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:29.737351 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:29.737319 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:32:29.846174 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:29.846139 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:29.964519 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:29.964498 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:30.066636 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:30.066586 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:51.683030 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:51.682989 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:51.776687 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:51.776661 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:32:54.755879 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:54.755826 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-788d4c69bf-fvmqb" podUID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" containerName="console" containerID="cri-o://670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54" gracePeriod=15 Jul 31 21:32:54.989295 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:54.989274 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:32:55.039798 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.039732 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.039798 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.039773 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.039798 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.039795 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.039994 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.039821 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.039994 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.039849 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.040114 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040014 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbhv8\" (UniqueName: \"kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.040114 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040059 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert\") pod \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\" (UID: \"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7\") " Jul 31 21:32:55.040224 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040197 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config" (OuterVolumeSpecName: "console-config") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:32:55.040224 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040195 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:32:55.040322 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040214 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:32:55.040375 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040327 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.040375 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040340 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-service-ca\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.040477 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040348 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-trusted-ca-bundle\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.040595 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.040527 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 21:32:55.042086 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.042050 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:32:55.042168 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.042090 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:32:55.042256 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.042236 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8" (OuterVolumeSpecName: "kube-api-access-tbhv8") pod "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" (UID: "4b56ff9c-b320-4f1e-8248-c8320f8b4ec7"). InnerVolumeSpecName "kube-api-access-tbhv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:32:55.141667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.141639 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-serving-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.141667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.141660 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-console-oauth-config\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.141667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.141669 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbhv8\" (UniqueName: \"kubernetes.io/projected/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-kube-api-access-tbhv8\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.141857 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.141677 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7-oauth-serving-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:32:55.792672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.792580 2577 generic.go:356] "Generic (PLEG): container finished" podID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" containerID="670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54" exitCode=0 Jul 31 21:32:55.792672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.792625 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-788d4c69bf-fvmqb" Jul 31 21:32:55.792672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.792638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788d4c69bf-fvmqb" event={"ID":"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7","Type":"ContainerDied","Data":"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54"} Jul 31 21:32:55.792672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.792677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-788d4c69bf-fvmqb" event={"ID":"4b56ff9c-b320-4f1e-8248-c8320f8b4ec7","Type":"ContainerDied","Data":"60129075bb8f6f9c93e6fbbeb9125c61bf50a4dfb5f1fd9ae704ced68ad935c7"} Jul 31 21:32:55.793199 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.792695 2577 scope.go:117] "RemoveContainer" containerID="670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54" Jul 31 21:32:55.800146 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.800113 2577 scope.go:117] "RemoveContainer" containerID="670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54" Jul 31 21:32:55.800425 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:32:55.800405 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54\": container with ID starting with 670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54 not found: ID does not exist" containerID="670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54" Jul 31 21:32:55.800492 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.800433 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54"} err="failed to get container status \"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54\": rpc error: code = NotFound desc = could not find container \"670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54\": container with ID starting with 670c2fb1c89a6b9a2c6a2697dc03eba6255cb8854e7583bf41b10f6398c76e54 not found: ID does not exist" Jul 31 21:32:55.806902 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.806883 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:32:55.812905 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:55.812887 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-788d4c69bf-fvmqb"] Jul 31 21:32:57.494611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:32:57.494574 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" path="/var/lib/kubelet/pods/4b56ff9c-b320-4f1e-8248-c8320f8b4ec7/volumes" Jul 31 21:33:18.381852 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:18.381777 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:19.231137 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:19.231102 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:21.331958 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:21.331922 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:21.986460 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:21.986428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:22.085452 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:22.085425 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:23.265662 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:23.265626 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:23.393893 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:23.393843 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:24.250298 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:24.250265 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:24.350735 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:24.350700 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:26.255730 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:26.255702 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:26.647852 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:26.647825 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:28.780451 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:28.780415 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:28.887747 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:28.887719 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:34.195874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:34.195840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:34.297263 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:34.297234 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:34.856272 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:34.856228 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:35.775948 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:35.775919 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:35.835938 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:35.835916 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:40.665750 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:40.665720 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:40.764496 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:40.764472 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:42.484037 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:42.484004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:44.223677 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:44.223639 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:44.296730 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:44.296695 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:55.386330 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:55.386295 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:55.484059 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:55.484033 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.021442 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.021403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.294039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.293952 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.395754 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.395724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.413348 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.413321 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd"] Jul 31 21:33:56.413587 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.413576 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" containerName="console" Jul 31 21:33:56.413625 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.413589 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" containerName="console" Jul 31 21:33:56.413657 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.413633 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b56ff9c-b320-4f1e-8248-c8320f8b4ec7" containerName="console" Jul 31 21:33:56.417631 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.417618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.420633 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.420610 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 31 21:33:56.420888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.420872 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wqfbt\"" Jul 31 21:33:56.420931 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.420885 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 31 21:33:56.420931 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.420907 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 31 21:33:56.421000 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.420943 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 31 21:33:56.432884 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.432863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd"] Jul 31 21:33:56.540324 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.540279 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.540324 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.540324 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.540525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.540346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.540525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.540423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.540525 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.540448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lh8\" (UniqueName: \"kubernetes.io/projected/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-kube-api-access-g9lh8\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.607170 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.607144 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.640942 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.640916 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.641133 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.640952 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.641133 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.640972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.641133 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.641014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.641133 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.641040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lh8\" (UniqueName: \"kubernetes.io/projected/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-kube-api-access-g9lh8\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.641394 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.641374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-manifests\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.643221 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.643197 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-tmp\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.643328 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.643313 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.643503 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.643483 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.650332 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.650308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lh8\" (UniqueName: \"kubernetes.io/projected/8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca-kube-api-access-g9lh8\") pod \"opendatahub-operator-controller-manager-7b88b5667d-6bxdd\" (UID: \"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca\") " pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.724864 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.724831 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.726783 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.726750 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:33:56.865313 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.865238 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd"] Jul 31 21:33:56.868327 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:33:56.868294 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a80db7d_c5ad_4126_a370_7b6c4fe9c2ca.slice/crio-0b9c055f9c75a092fb8d4321a56506609bc012841d255ead21f4f46c226ad30e WatchSource:0}: Error finding container 0b9c055f9c75a092fb8d4321a56506609bc012841d255ead21f4f46c226ad30e: Status 404 returned error can't find the container with id 0b9c055f9c75a092fb8d4321a56506609bc012841d255ead21f4f46c226ad30e Jul 31 21:33:56.869961 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.869944 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:33:56.874337 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.874319 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.975205 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.975167 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:56.988080 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:56.988049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" event={"ID":"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca","Type":"ContainerStarted","Data":"0b9c055f9c75a092fb8d4321a56506609bc012841d255ead21f4f46c226ad30e"} Jul 31 21:33:57.080941 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:57.080908 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:33:57.175617 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:33:57.175533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:00.000930 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:00.000897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" event={"ID":"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca","Type":"ContainerStarted","Data":"97746c1822c9c14956027ac55ab77aaf54a4f9766b92d53426aae7f5a62d06ce"} Jul 31 21:34:01.005256 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:01.005171 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca" containerID="97746c1822c9c14956027ac55ab77aaf54a4f9766b92d53426aae7f5a62d06ce" exitCode=0 Jul 31 21:34:01.005256 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:01.005243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" event={"ID":"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca","Type":"ContainerDied","Data":"97746c1822c9c14956027ac55ab77aaf54a4f9766b92d53426aae7f5a62d06ce"} Jul 31 21:34:02.010313 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:02.010276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" event={"ID":"8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca","Type":"ContainerStarted","Data":"2d3caf34592a17846e263c6943a6a83b6ea1dd3690ce6146082d5063f8b33be9"} Jul 31 21:34:02.010751 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:02.010365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:34:02.038687 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:02.038636 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" podStartSLOduration=2.077902564 podStartE2EDuration="6.038620308s" totalImagesPullingTime="2.995180596s" totalInitContainerRuntime="965.537148ms" isStatefulPod=false podCreationTimestamp="2026-07-31 21:33:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:02.037004512 +0000 UTC m=+493.071817860" watchObservedRunningTime="2026-07-31 21:34:02.038620308 +0000 UTC m=+493.073433653" Jul 31 21:34:08.072432 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:08.072402 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:08.169578 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:08.169552 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:08.823056 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:08.823024 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:08.917039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:08.917003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:12.392706 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:12.392668 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:12.492913 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:12.492887 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:12.828387 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:12.828344 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:12.927242 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:12.927217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:13.015819 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:13.015796 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b88b5667d-6bxdd" Jul 31 21:34:15.071748 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.071721 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn"] Jul 31 21:34:15.074800 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.074786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.080369 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 31 21:34:15.080682 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080665 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 31 21:34:15.080758 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080681 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 31 21:34:15.080758 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080705 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 31 21:34:15.080846 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080776 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 31 21:34:15.080846 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.080823 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bvvjs\"" Jul 31 21:34:15.087499 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.087478 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn"] Jul 31 21:34:15.172707 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.172682 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dca126c-8746-4c13-aa95-10ee64d7d87d-manager-config\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.172801 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.172730 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.172801 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.172763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbn5k\" (UniqueName: \"kubernetes.io/projected/8dca126c-8746-4c13-aa95-10ee64d7d87d-kube-api-access-sbn5k\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.172875 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.172817 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-metrics-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.273574 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.273551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dca126c-8746-4c13-aa95-10ee64d7d87d-manager-config\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.273647 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.273596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.273647 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.273613 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbn5k\" (UniqueName: \"kubernetes.io/projected/8dca126c-8746-4c13-aa95-10ee64d7d87d-kube-api-access-sbn5k\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.273647 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.273637 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-metrics-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.274320 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.274238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dca126c-8746-4c13-aa95-10ee64d7d87d-manager-config\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.276043 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.276016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.276043 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.276037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dca126c-8746-4c13-aa95-10ee64d7d87d-metrics-cert\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.289387 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.289368 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbn5k\" (UniqueName: \"kubernetes.io/projected/8dca126c-8746-4c13-aa95-10ee64d7d87d-kube-api-access-sbn5k\") pod \"lws-controller-manager-5579c9d97f-sfrfn\" (UID: \"8dca126c-8746-4c13-aa95-10ee64d7d87d\") " pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.388340 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.388288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:15.554651 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:34:15.554625 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dca126c_8746_4c13_aa95_10ee64d7d87d.slice/crio-d52b80a74cc5bc3cd472b27f089fe0038d5ac4b5e99681d99accc2889d50bfb2 WatchSource:0}: Error finding container d52b80a74cc5bc3cd472b27f089fe0038d5ac4b5e99681d99accc2889d50bfb2: Status 404 returned error can't find the container with id d52b80a74cc5bc3cd472b27f089fe0038d5ac4b5e99681d99accc2889d50bfb2 Jul 31 21:34:15.556968 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.556889 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn"] Jul 31 21:34:15.937771 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:15.937743 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:16.056441 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.056409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" event={"ID":"8dca126c-8746-4c13-aa95-10ee64d7d87d","Type":"ContainerStarted","Data":"d52b80a74cc5bc3cd472b27f089fe0038d5ac4b5e99681d99accc2889d50bfb2"} Jul 31 21:34:16.081839 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.081810 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:16.759873 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.759840 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:16.826105 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.826051 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm"] Jul 31 21:34:16.829087 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.829043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.834662 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.834640 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 31 21:34:16.834820 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.834648 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 31 21:34:16.834890 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.834866 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-h247x\"" Jul 31 21:34:16.834990 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.834975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 31 21:34:16.835505 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.835486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 31 21:34:16.871784 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.871760 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm"] Jul 31 21:34:16.886979 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.886874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tmp\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.886979 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.886940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpkm7\" (UniqueName: \"kubernetes.io/projected/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-kube-api-access-lpkm7\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.886979 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.886983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.988396 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.988367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tmp\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.988396 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.988411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpkm7\" (UniqueName: \"kubernetes.io/projected/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-kube-api-access-lpkm7\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.988644 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.988446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:16.988644 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:34:16.988565 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 31 21:34:16.988644 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:34:16.988628 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs podName:5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0 nodeName:}" failed. No retries permitted until 2026-07-31 21:34:17.488605059 +0000 UTC m=+508.523418407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs") pod "kube-auth-proxy-7d77494cc5-htnsm" (UID: "5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0") : secret "kube-auth-proxy-tls" not found Jul 31 21:34:16.990965 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:16.990937 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tmp\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:17.008898 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.008862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpkm7\" (UniqueName: \"kubernetes.io/projected/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-kube-api-access-lpkm7\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:17.225151 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.225036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:17.368026 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.367996 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:17.492975 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.492890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:17.495326 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.495296 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0-tls-certs\") pod \"kube-auth-proxy-7d77494cc5-htnsm\" (UID: \"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0\") " pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:17.517247 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.517214 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:17.739612 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.739580 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" Jul 31 21:34:17.984873 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:17.984850 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm"] Jul 31 21:34:17.987820 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:34:17.987796 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccd05e2_e7f7_49c4_b95b_5dc5c3e260c0.slice/crio-fc7cb2dcaabbdedfd29a28a33282ae22cdb3730e5c93ad87d5c42deb04d0fc6a WatchSource:0}: Error finding container fc7cb2dcaabbdedfd29a28a33282ae22cdb3730e5c93ad87d5c42deb04d0fc6a: Status 404 returned error can't find the container with id fc7cb2dcaabbdedfd29a28a33282ae22cdb3730e5c93ad87d5c42deb04d0fc6a Jul 31 21:34:18.065197 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.065100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" event={"ID":"8dca126c-8746-4c13-aa95-10ee64d7d87d","Type":"ContainerStarted","Data":"6cc2749b1aa16e0a551aac4126047f4cf5d3e126d232b373150a88d0a9c0f1f7"} Jul 31 21:34:18.065363 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.065211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:18.066063 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.066043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" event={"ID":"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0","Type":"ContainerStarted","Data":"fc7cb2dcaabbdedfd29a28a33282ae22cdb3730e5c93ad87d5c42deb04d0fc6a"} Jul 31 21:34:18.114916 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.114851 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" podStartSLOduration=0.769842069 podStartE2EDuration="3.114829571s" totalImagesPullingTime="2.344987502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:18.114725499 +0000 UTC m=+509.149538846" watchObservedRunningTime="2026-07-31 21:34:18.114829571 +0000 UTC m=+509.149642919" Jul 31 21:34:18.522624 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.522431 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:18.777060 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:18.776971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:19.243529 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:19.243496 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:19.336460 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:19.336428 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:20.866789 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:20.866703 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:21.079059 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:21.079024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" event={"ID":"5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0","Type":"ContainerStarted","Data":"09700c129f69c7be10c9f20a072c88e23633bc81b180d6b07a35d931cf27a221"} Jul 31 21:34:21.096799 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:21.096746 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d77494cc5-htnsm" podStartSLOduration=2.471141832 podStartE2EDuration="5.096727863s" totalImagesPullingTime="2.625586031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:21.095714368 +0000 UTC m=+512.130527717" watchObservedRunningTime="2026-07-31 21:34:21.096727863 +0000 UTC m=+512.131541211" Jul 31 21:34:25.963254 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:25.963222 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:26.072568 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:26.072539 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:26.938956 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:26.938923 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:27.127731 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:27.127686 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:27.287260 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:27.287183 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:28.217574 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.217538 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:28.390877 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.390847 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:28.402123 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.402100 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2"] Jul 31 21:34:28.405324 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.405307 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.413214 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.413194 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 31 21:34:28.413331 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.413237 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-s4j8b\"" Jul 31 21:34:28.446962 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.446929 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2"] Jul 31 21:34:28.471935 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.471874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.471935 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.471920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-654jv\" (UniqueName: \"kubernetes.io/projected/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-kube-api-access-654jv\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.572385 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.572364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.572519 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.572399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-654jv\" (UniqueName: \"kubernetes.io/projected/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-kube-api-access-654jv\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.572582 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:34:28.572514 2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 31 21:34:28.572632 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:34:28.572584 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert podName:3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9 nodeName:}" failed. No retries permitted until 2026-07-31 21:34:29.072562698 +0000 UTC m=+520.107376029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert") pod "llmisvc-controller-manager-777c6bd7d5-g7vm2" (UID: "3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9") : secret "llmisvc-webhook-server-cert" not found Jul 31 21:34:28.604841 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.604814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-654jv\" (UniqueName: \"kubernetes.io/projected/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-kube-api-access-654jv\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:28.666672 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.666652 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:28.894189 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:28.894159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:29.073188 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.073159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5579c9d97f-sfrfn" Jul 31 21:34:29.076821 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.076796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:29.079160 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.079140 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g7vm2\" (UID: \"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:29.314834 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.314739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:29.460455 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.460427 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2"] Jul 31 21:34:29.463019 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:34:29.462994 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3e8ce4b6_c5b1_45b9_ae5c_dbd4855082a9.slice/crio-3c7a041a880e2fa963ad4c12daefbc4d28c92f9fef8bca30d380c16da47c20b2 WatchSource:0}: Error finding container 3c7a041a880e2fa963ad4c12daefbc4d28c92f9fef8bca30d380c16da47c20b2: Status 404 returned error can't find the container with id 3c7a041a880e2fa963ad4c12daefbc4d28c92f9fef8bca30d380c16da47c20b2 Jul 31 21:34:29.675758 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.675724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:29.789094 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.789053 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:29.913696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:29.913670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:30.113163 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:30.113098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" event={"ID":"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9","Type":"ContainerStarted","Data":"3c7a041a880e2fa963ad4c12daefbc4d28c92f9fef8bca30d380c16da47c20b2"} Jul 31 21:34:31.490009 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:31.489971 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:31.592686 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:31.592651 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:31.718502 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:31.718458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:33.124033 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:33.123999 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" event={"ID":"3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9","Type":"ContainerStarted","Data":"18973b6907408afb381f7e6701026316b33f108d55c89d892e29af1feb15b3c9"} Jul 31 21:34:33.124448 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:33.124114 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:34:33.151176 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:33.151137 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" podStartSLOduration=2.527328042 podStartE2EDuration="5.1511234s" totalImagesPullingTime="2.623795358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:34:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:34:33.148032275 +0000 UTC m=+524.182845622" watchObservedRunningTime="2026-07-31 21:34:33.1511234 +0000 UTC m=+524.185936753" Jul 31 21:34:49.224565 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:49.224533 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:34:50.345191 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:34:50.345159 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:04.130098 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:04.130052 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g7vm2" Jul 31 21:35:17.533900 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:17.533848 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:17.648669 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:17.648638 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:31.349004 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:31.348959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:32.135934 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:32.135885 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:32.954611 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:32.954562 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:35.883812 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:35.883776 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:36.019592 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:36.019535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:36.178416 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:36.178328 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:36.578890 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:36.578865 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:37.222351 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:37.222320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:39.170285 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:39.170232 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:40.231221 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:40.231189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:40.631465 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:40.631437 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:41.170418 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:41.170377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:41.547281 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:41.547195 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:42.821028 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:42.821004 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:44.504414 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.504383 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr"] Jul 31 21:35:44.507613 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.507594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.509988 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.509963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 31 21:35:44.510520 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.510499 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jbxq9\"" Jul 31 21:35:44.510520 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.510509 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 31 21:35:44.510645 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.510499 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 31 21:35:44.510857 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.510842 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 31 21:35:44.519542 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.519521 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr"] Jul 31 21:35:44.523235 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.523217 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:44.697204 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.697171 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dbc045-c78e-4984-811d-79f1a6615eb9-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.697204 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.697203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37dbc045-c78e-4984-811d-79f1a6615eb9-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.697398 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.697294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc464\" (UniqueName: \"kubernetes.io/projected/37dbc045-c78e-4984-811d-79f1a6615eb9-kube-api-access-dc464\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.798237 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.798168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc464\" (UniqueName: \"kubernetes.io/projected/37dbc045-c78e-4984-811d-79f1a6615eb9-kube-api-access-dc464\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.798237 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.798199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dbc045-c78e-4984-811d-79f1a6615eb9-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.798237 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.798218 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37dbc045-c78e-4984-811d-79f1a6615eb9-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.798857 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.798829 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/37dbc045-c78e-4984-811d-79f1a6615eb9-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.800641 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.800621 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/37dbc045-c78e-4984-811d-79f1a6615eb9-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.806756 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.806737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc464\" (UniqueName: \"kubernetes.io/projected/37dbc045-c78e-4984-811d-79f1a6615eb9-kube-api-access-dc464\") pod \"kuadrant-console-plugin-598f86468b-gthrr\" (UID: \"37dbc045-c78e-4984-811d-79f1a6615eb9\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.815782 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.815764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" Jul 31 21:35:44.816562 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.816538 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:44.941373 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:44.941234 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr"] Jul 31 21:35:44.943752 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:35:44.943728 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37dbc045_c78e_4984_811d_79f1a6615eb9.slice/crio-e0928fc3fbdbaa4ae70219b68d1cb8b7b0134068954058bb3a7dd154e936d9dc WatchSource:0}: Error finding container e0928fc3fbdbaa4ae70219b68d1cb8b7b0134068954058bb3a7dd154e936d9dc: Status 404 returned error can't find the container with id e0928fc3fbdbaa4ae70219b68d1cb8b7b0134068954058bb3a7dd154e936d9dc Jul 31 21:35:45.267802 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:45.267776 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:45.363714 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:45.363685 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" event={"ID":"37dbc045-c78e-4984-811d-79f1a6615eb9","Type":"ContainerStarted","Data":"e0928fc3fbdbaa4ae70219b68d1cb8b7b0134068954058bb3a7dd154e936d9dc"} Jul 31 21:35:45.368150 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:45.368067 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:46.575358 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:46.575320 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:46.680291 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:46.680254 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:46.968958 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:46.968884 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:47.043541 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:47.043505 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:47.411624 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:47.411593 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:47.484496 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:47.484455 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:49.380134 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:49.380103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" event={"ID":"37dbc045-c78e-4984-811d-79f1a6615eb9","Type":"ContainerStarted","Data":"f70f0beef05b3c0568417dd12406a977069dfd76b33f5af6c11845b90b000d90"} Jul 31 21:35:49.396835 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:49.396785 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-gthrr" podStartSLOduration=1.17865174 podStartE2EDuration="5.396772012s" totalImagesPullingTime="4.218120272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:35:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:35:49.395622594 +0000 UTC m=+600.430435939" watchObservedRunningTime="2026-07-31 21:35:49.396772012 +0000 UTC m=+600.431585359" Jul 31 21:35:51.850085 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:51.850040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:51.950585 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:51.950535 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:52.051994 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:52.051969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:52.120396 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:52.120342 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:55.501002 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:55.500969 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:55.606176 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:55.606146 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:57.849726 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:57.849702 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:35:57.947845 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:35:57.947817 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:02.590874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:02.590841 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:02.698417 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:02.698388 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:07.865330 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:07.865297 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:07.964984 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:07.964954 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:08.227667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:08.227579 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:08.326992 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:08.326959 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:08.444652 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:08.444629 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:08.527151 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:08.527096 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:10.650813 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:10.650725 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:16.813841 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:16.813809 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:16.911490 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:16.911458 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:19.239754 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:19.239724 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:19.339317 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:19.339292 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:22.258778 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:22.258748 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:24.004330 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:24.004291 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:24.108260 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:24.108229 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:24.266815 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:24.266740 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:24.460264 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:24.460239 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:25.979257 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:25.979228 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:26.082308 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.082279 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:26.180091 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.180048 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:26.804164 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.804138 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:26.823531 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.823496 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:26.823694 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.823581 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:26.825714 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.825691 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t2zrx\"" Jul 31 21:36:26.845413 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.845390 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:26.896531 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.896511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87bl\" (UniqueName: \"kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl\") pod \"authorino-b54df94b4-7x422\" (UID: \"d18f8573-0d91-4a4c-8c46-add66e360d09\") " pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:26.914284 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.914262 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:26.940059 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.940039 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:36:26.943443 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.943430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:36:26.953196 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.953174 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:36:26.997293 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.997272 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gjld\" (UniqueName: \"kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld\") pod \"authorino-c548b5d7d-84lm8\" (UID: \"969ca705-7069-427d-8e6b-0e2f37d83b4a\") " pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:36:26.997568 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:26.997318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87bl\" (UniqueName: \"kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl\") pod \"authorino-b54df94b4-7x422\" (UID: \"d18f8573-0d91-4a4c-8c46-add66e360d09\") " pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:27.005591 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.005564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87bl\" (UniqueName: \"kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl\") pod \"authorino-b54df94b4-7x422\" (UID: \"d18f8573-0d91-4a4c-8c46-add66e360d09\") " pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:27.098463 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.098442 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gjld\" (UniqueName: \"kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld\") pod \"authorino-c548b5d7d-84lm8\" (UID: \"969ca705-7069-427d-8e6b-0e2f37d83b4a\") " pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:36:27.113452 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.113428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gjld\" (UniqueName: \"kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld\") pod \"authorino-c548b5d7d-84lm8\" (UID: \"969ca705-7069-427d-8e6b-0e2f37d83b4a\") " pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:36:27.132249 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.132229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:27.251476 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.251426 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:27.252244 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.252222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:36:27.254015 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:36:27.253993 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18f8573_0d91_4a4c_8c46_add66e360d09.slice/crio-5e2a9347a3d5f9229be2b9cc6cd41dd4792ef580c150052f40c2f1be4bd56bd8 WatchSource:0}: Error finding container 5e2a9347a3d5f9229be2b9cc6cd41dd4792ef580c150052f40c2f1be4bd56bd8: Status 404 returned error can't find the container with id 5e2a9347a3d5f9229be2b9cc6cd41dd4792ef580c150052f40c2f1be4bd56bd8 Jul 31 21:36:27.370217 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.370149 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:36:27.372751 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:36:27.372729 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod969ca705_7069_427d_8e6b_0e2f37d83b4a.slice/crio-b6fa73c28d2ec27053a9adb3492f0ef74c96b63ad68bb1d96a71a36d1e21906c WatchSource:0}: Error finding container b6fa73c28d2ec27053a9adb3492f0ef74c96b63ad68bb1d96a71a36d1e21906c: Status 404 returned error can't find the container with id b6fa73c28d2ec27053a9adb3492f0ef74c96b63ad68bb1d96a71a36d1e21906c Jul 31 21:36:27.508639 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.508615 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-84lm8" event={"ID":"969ca705-7069-427d-8e6b-0e2f37d83b4a","Type":"ContainerStarted","Data":"b6fa73c28d2ec27053a9adb3492f0ef74c96b63ad68bb1d96a71a36d1e21906c"} Jul 31 21:36:27.509803 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:27.509779 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7x422" event={"ID":"d18f8573-0d91-4a4c-8c46-add66e360d09","Type":"ContainerStarted","Data":"5e2a9347a3d5f9229be2b9cc6cd41dd4792ef580c150052f40c2f1be4bd56bd8"} Jul 31 21:36:30.523834 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:30.523799 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-84lm8" event={"ID":"969ca705-7069-427d-8e6b-0e2f37d83b4a","Type":"ContainerStarted","Data":"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66"} Jul 31 21:36:30.525252 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:30.525229 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7x422" event={"ID":"d18f8573-0d91-4a4c-8c46-add66e360d09","Type":"ContainerStarted","Data":"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a"} Jul 31 21:36:30.539353 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:30.539310 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-84lm8" podStartSLOduration=2.120447116 podStartE2EDuration="4.539296444s" totalImagesPullingTime="2.418849328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:30.538894745 +0000 UTC m=+641.573708088" watchObservedRunningTime="2026-07-31 21:36:30.539296444 +0000 UTC m=+641.574109770" Jul 31 21:36:30.557006 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:30.556946 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-7x422" podStartSLOduration=2.030119464 podStartE2EDuration="4.556927453s" totalImagesPullingTime="2.526807989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:36:30.555829574 +0000 UTC m=+641.590642923" watchObservedRunningTime="2026-07-31 21:36:30.556927453 +0000 UTC m=+641.591740802" Jul 31 21:36:30.585673 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:30.585643 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:32.531738 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:32.531697 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-7x422" podUID="d18f8573-0d91-4a4c-8c46-add66e360d09" containerName="authorino" containerID="cri-o://31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a" gracePeriod=30 Jul 31 21:36:32.766920 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:32.766894 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:32.840462 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:32.840440 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k87bl\" (UniqueName: \"kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl\") pod \"d18f8573-0d91-4a4c-8c46-add66e360d09\" (UID: \"d18f8573-0d91-4a4c-8c46-add66e360d09\") " Jul 31 21:36:32.842565 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:32.842535 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl" (OuterVolumeSpecName: "kube-api-access-k87bl") pod "d18f8573-0d91-4a4c-8c46-add66e360d09" (UID: "d18f8573-0d91-4a4c-8c46-add66e360d09"). InnerVolumeSpecName "kube-api-access-k87bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:36:32.941016 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:32.940973 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k87bl\" (UniqueName: \"kubernetes.io/projected/d18f8573-0d91-4a4c-8c46-add66e360d09-kube-api-access-k87bl\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:36:33.536235 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.536203 2577 generic.go:356] "Generic (PLEG): container finished" podID="d18f8573-0d91-4a4c-8c46-add66e360d09" containerID="31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a" exitCode=0 Jul 31 21:36:33.536556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.536246 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-7x422" Jul 31 21:36:33.536556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.536243 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7x422" event={"ID":"d18f8573-0d91-4a4c-8c46-add66e360d09","Type":"ContainerDied","Data":"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a"} Jul 31 21:36:33.536556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.536281 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-7x422" event={"ID":"d18f8573-0d91-4a4c-8c46-add66e360d09","Type":"ContainerDied","Data":"5e2a9347a3d5f9229be2b9cc6cd41dd4792ef580c150052f40c2f1be4bd56bd8"} Jul 31 21:36:33.536556 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.536301 2577 scope.go:117] "RemoveContainer" containerID="31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a" Jul 31 21:36:33.543725 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.543709 2577 scope.go:117] "RemoveContainer" containerID="31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a" Jul 31 21:36:33.543967 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:36:33.543948 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a\": container with ID starting with 31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a not found: ID does not exist" containerID="31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a" Jul 31 21:36:33.544025 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.543975 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a"} err="failed to get container status \"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a\": rpc error: code = NotFound desc = could not find container \"31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a\": container with ID starting with 31f4800f6ef94f8305a1913069a868395fd1952b2d5ee2cf6e765ccb71799e2a not found: ID does not exist" Jul 31 21:36:33.563333 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.563313 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:33.570434 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:33.570415 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-7x422"] Jul 31 21:36:35.494150 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:35.494116 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18f8573-0d91-4a4c-8c46-add66e360d09" path="/var/lib/kubelet/pods/d18f8573-0d91-4a4c-8c46-add66e360d09/volumes" Jul 31 21:36:47.042066 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:47.042030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:47.147623 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:47.147596 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:47.568774 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:47.568744 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:56.409576 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:56.409543 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:59.353701 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.353671 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:59.594804 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.594777 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2rsgh"] Jul 31 21:36:59.595035 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.595023 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18f8573-0d91-4a4c-8c46-add66e360d09" containerName="authorino" Jul 31 21:36:59.595104 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.595037 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18f8573-0d91-4a4c-8c46-add66e360d09" containerName="authorino" Jul 31 21:36:59.595160 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.595105 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18f8573-0d91-4a4c-8c46-add66e360d09" containerName="authorino" Jul 31 21:36:59.599110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.599094 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:36:59.605863 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.605844 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2rsgh"] Jul 31 21:36:59.724015 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.723982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66v7b\" (UniqueName: \"kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b\") pod \"authorino-5dc7ccb5f-2rsgh\" (UID: \"b777a11f-3852-4bc5-b29e-54e84fa12fd8\") " pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:36:59.736085 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.736054 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:36:59.784017 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.783993 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2rsgh"] Jul 31 21:36:59.784207 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:36:59.784190 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-66v7b], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" podUID="b777a11f-3852-4bc5-b29e-54e84fa12fd8" Jul 31 21:36:59.810433 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.810410 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-r9s62"] Jul 31 21:36:59.813283 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.813270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:36:59.815790 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.815775 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 31 21:36:59.820939 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.820912 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-r9s62"] Jul 31 21:36:59.824475 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.824453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66v7b\" (UniqueName: \"kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b\") pod \"authorino-5dc7ccb5f-2rsgh\" (UID: \"b777a11f-3852-4bc5-b29e-54e84fa12fd8\") " pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:36:59.834839 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.834817 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66v7b\" (UniqueName: \"kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b\") pod \"authorino-5dc7ccb5f-2rsgh\" (UID: \"b777a11f-3852-4bc5-b29e-54e84fa12fd8\") " pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:36:59.852535 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.852512 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-r9s62"] Jul 31 21:36:59.852687 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:36:59.852672 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wfsgf tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-wfsgf tls-cert]: context canceled" pod="kuadrant-system/authorino-687bd45585-r9s62" podUID="a20a727d-4595-4b72-9dfd-d632b7782e47" Jul 31 21:36:59.883285 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.883237 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:36:59.886162 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.886149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:36:59.894175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.894150 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:36:59.924776 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.924752 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfsgf\" (UniqueName: \"kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:36:59.924866 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:36:59.924797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.025401 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.025378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.025491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.025415 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dbm2\" (UniqueName: \"kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.025491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.025436 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfsgf\" (UniqueName: \"kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.025491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.025458 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.027691 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.027674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.034642 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.034618 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfsgf\" (UniqueName: \"kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf\") pod \"authorino-687bd45585-r9s62\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.126570 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.126547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.126640 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.126597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dbm2\" (UniqueName: \"kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.128594 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.128570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.135420 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.135371 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dbm2\" (UniqueName: \"kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2\") pod \"authorino-67c45db895-vf26p\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.193819 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.193791 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:37:00.312528 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.312506 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:37:00.314779 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:37:00.314759 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c521b14_879c_4b9d_a14c_9b70b60aec77.slice/crio-80221376a325e029f8a7fa2d4d2aadcf331c0cb5f657409faff132afeff0e0db WatchSource:0}: Error finding container 80221376a325e029f8a7fa2d4d2aadcf331c0cb5f657409faff132afeff0e0db: Status 404 returned error can't find the container with id 80221376a325e029f8a7fa2d4d2aadcf331c0cb5f657409faff132afeff0e0db Jul 31 21:37:00.623726 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.623699 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:37:00.624108 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.623736 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.624108 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.623699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c45db895-vf26p" event={"ID":"1c521b14-879c-4b9d-a14c-9b70b60aec77","Type":"ContainerStarted","Data":"80221376a325e029f8a7fa2d4d2aadcf331c0cb5f657409faff132afeff0e0db"} Jul 31 21:37:00.631402 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.631383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:37:00.633291 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.633277 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:00.731396 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.731375 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66v7b\" (UniqueName: \"kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b\") pod \"b777a11f-3852-4bc5-b29e-54e84fa12fd8\" (UID: \"b777a11f-3852-4bc5-b29e-54e84fa12fd8\") " Jul 31 21:37:00.731518 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.731408 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert\") pod \"a20a727d-4595-4b72-9dfd-d632b7782e47\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " Jul 31 21:37:00.731518 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.731434 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfsgf\" (UniqueName: \"kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf\") pod \"a20a727d-4595-4b72-9dfd-d632b7782e47\" (UID: \"a20a727d-4595-4b72-9dfd-d632b7782e47\") " Jul 31 21:37:00.733675 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.733638 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf" (OuterVolumeSpecName: "kube-api-access-wfsgf") pod "a20a727d-4595-4b72-9dfd-d632b7782e47" (UID: "a20a727d-4595-4b72-9dfd-d632b7782e47"). InnerVolumeSpecName "kube-api-access-wfsgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:37:00.733675 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.733641 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b" (OuterVolumeSpecName: "kube-api-access-66v7b") pod "b777a11f-3852-4bc5-b29e-54e84fa12fd8" (UID: "b777a11f-3852-4bc5-b29e-54e84fa12fd8"). InnerVolumeSpecName "kube-api-access-66v7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:37:00.733812 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.733691 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a20a727d-4595-4b72-9dfd-d632b7782e47" (UID: "a20a727d-4595-4b72-9dfd-d632b7782e47"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:37:00.832876 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.832852 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66v7b\" (UniqueName: \"kubernetes.io/projected/b777a11f-3852-4bc5-b29e-54e84fa12fd8-kube-api-access-66v7b\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:37:00.832876 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.832876 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a20a727d-4595-4b72-9dfd-d632b7782e47-tls-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:37:00.833008 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:00.832890 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfsgf\" (UniqueName: \"kubernetes.io/projected/a20a727d-4595-4b72-9dfd-d632b7782e47-kube-api-access-wfsgf\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:37:01.627940 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.627906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c45db895-vf26p" event={"ID":"1c521b14-879c-4b9d-a14c-9b70b60aec77","Type":"ContainerStarted","Data":"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33"} Jul 31 21:37:01.627940 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.627927 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-r9s62" Jul 31 21:37:01.628335 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.627946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2rsgh" Jul 31 21:37:01.643535 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.643493 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67c45db895-vf26p" podStartSLOduration=2.198939234 podStartE2EDuration="2.643480784s" totalImagesPullingTime="444.54155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:37:01.642436095 +0000 UTC m=+672.677249443" watchObservedRunningTime="2026-07-31 21:37:01.643480784 +0000 UTC m=+672.678294131" Jul 31 21:37:01.668467 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.668436 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2rsgh"] Jul 31 21:37:01.674299 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.674275 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:37:01.674474 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.674451 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-84lm8" podUID="969ca705-7069-427d-8e6b-0e2f37d83b4a" containerName="authorino" containerID="cri-o://5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66" gracePeriod=30 Jul 31 21:37:01.676983 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.676953 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2rsgh"] Jul 31 21:37:01.703130 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.703061 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-r9s62"] Jul 31 21:37:01.711874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.711850 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-r9s62"] Jul 31 21:37:01.912239 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:01.912214 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:37:02.041638 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.041604 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gjld\" (UniqueName: \"kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld\") pod \"969ca705-7069-427d-8e6b-0e2f37d83b4a\" (UID: \"969ca705-7069-427d-8e6b-0e2f37d83b4a\") " Jul 31 21:37:02.043739 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.043686 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld" (OuterVolumeSpecName: "kube-api-access-7gjld") pod "969ca705-7069-427d-8e6b-0e2f37d83b4a" (UID: "969ca705-7069-427d-8e6b-0e2f37d83b4a"). InnerVolumeSpecName "kube-api-access-7gjld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:37:02.142145 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.142115 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gjld\" (UniqueName: \"kubernetes.io/projected/969ca705-7069-427d-8e6b-0e2f37d83b4a-kube-api-access-7gjld\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:37:02.633352 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.633317 2577 generic.go:356] "Generic (PLEG): container finished" podID="969ca705-7069-427d-8e6b-0e2f37d83b4a" containerID="5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66" exitCode=0 Jul 31 21:37:02.633794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.633360 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-84lm8" Jul 31 21:37:02.633794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.633405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-84lm8" event={"ID":"969ca705-7069-427d-8e6b-0e2f37d83b4a","Type":"ContainerDied","Data":"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66"} Jul 31 21:37:02.633794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.633442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-84lm8" event={"ID":"969ca705-7069-427d-8e6b-0e2f37d83b4a","Type":"ContainerDied","Data":"b6fa73c28d2ec27053a9adb3492f0ef74c96b63ad68bb1d96a71a36d1e21906c"} Jul 31 21:37:02.633794 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.633458 2577 scope.go:117] "RemoveContainer" containerID="5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66" Jul 31 21:37:02.641652 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.641633 2577 scope.go:117] "RemoveContainer" containerID="5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66" Jul 31 21:37:02.641888 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:37:02.641871 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66\": container with ID starting with 5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66 not found: ID does not exist" containerID="5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66" Jul 31 21:37:02.641961 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.641895 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66"} err="failed to get container status \"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66\": rpc error: code = NotFound desc = could not find container \"5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66\": container with ID starting with 5591c9a9cb5517d3213ee9352e7a59b6093dea34ee12ace05e72f74190d61b66 not found: ID does not exist" Jul 31 21:37:02.652942 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.652923 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:37:02.657095 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:02.657062 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-84lm8"] Jul 31 21:37:03.493933 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:03.493901 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="969ca705-7069-427d-8e6b-0e2f37d83b4a" path="/var/lib/kubelet/pods/969ca705-7069-427d-8e6b-0e2f37d83b4a/volumes" Jul 31 21:37:03.494234 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:03.494221 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a20a727d-4595-4b72-9dfd-d632b7782e47" path="/var/lib/kubelet/pods/a20a727d-4595-4b72-9dfd-d632b7782e47/volumes" Jul 31 21:37:03.494395 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:03.494384 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b777a11f-3852-4bc5-b29e-54e84fa12fd8" path="/var/lib/kubelet/pods/b777a11f-3852-4bc5-b29e-54e84fa12fd8/volumes" Jul 31 21:37:06.252322 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:06.252294 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:06.352976 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:06.352944 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:06.453709 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:06.453679 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:08.561150 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:08.561114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:08.686568 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:08.686542 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:39.668301 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:39.668272 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:39.951812 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:39.951731 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:40.037888 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:40.037860 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:41.445917 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:41.445804 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:41.878558 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:41.878529 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:41.981403 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:41.981377 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:42.049401 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:42.049378 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:49.222343 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:49.222308 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:49.325714 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:49.325691 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:50.289906 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:50.289878 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:50.391678 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:50.391655 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:53.339247 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:53.339213 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:53.491234 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:53.491203 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:37:58.583223 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:37:58.583189 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:02.926314 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:02.926284 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:03.026894 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:03.026846 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:10.782830 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:10.782789 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:22.479555 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:22.479525 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:24.834004 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.833973 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l"] Jul 31 21:38:24.834475 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.834278 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="969ca705-7069-427d-8e6b-0e2f37d83b4a" containerName="authorino" Jul 31 21:38:24.834475 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.834290 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="969ca705-7069-427d-8e6b-0e2f37d83b4a" containerName="authorino" Jul 31 21:38:24.834475 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.834333 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="969ca705-7069-427d-8e6b-0e2f37d83b4a" containerName="authorino" Jul 31 21:38:24.837175 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.837157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.840032 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.840002 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 31 21:38:24.840226 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.840017 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 31 21:38:24.840226 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.840210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5zjwc\"" Jul 31 21:38:24.840370 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.840154 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 31 21:38:24.850466 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.850445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l"] Jul 31 21:38:24.884686 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.884665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:24.903529 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903507 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.903639 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.903639 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2da406d6-b27d-4dc8-adbf-e27d945f8973-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.903639 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.903738 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnfsg\" (UniqueName: \"kubernetes.io/projected/2da406d6-b27d-4dc8-adbf-e27d945f8973-kube-api-access-pnfsg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:24.903738 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:24.903675 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.004949 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.004921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005117 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.004964 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005117 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2da406d6-b27d-4dc8-adbf-e27d945f8973-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005117 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005040 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005117 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005094 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnfsg\" (UniqueName: \"kubernetes.io/projected/2da406d6-b27d-4dc8-adbf-e27d945f8973-kube-api-access-pnfsg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005347 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005120 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005463 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005442 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005530 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.005589 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.005567 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.007386 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.007357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2da406d6-b27d-4dc8-adbf-e27d945f8973-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.007546 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.007531 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2da406d6-b27d-4dc8-adbf-e27d945f8973-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.012766 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.012742 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnfsg\" (UniqueName: \"kubernetes.io/projected/2da406d6-b27d-4dc8-adbf-e27d945f8973-kube-api-access-pnfsg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l\" (UID: \"2da406d6-b27d-4dc8-adbf-e27d945f8973\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.147468 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.147414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:25.274200 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.274171 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l"] Jul 31 21:38:25.277544 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:38:25.277514 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da406d6_b27d_4dc8_adbf_e27d945f8973.slice/crio-6997a6681d4ad52e49a7cecbe7050513191e080fba10ba22b04896b3f4e87602 WatchSource:0}: Error finding container 6997a6681d4ad52e49a7cecbe7050513191e080fba10ba22b04896b3f4e87602: Status 404 returned error can't find the container with id 6997a6681d4ad52e49a7cecbe7050513191e080fba10ba22b04896b3f4e87602 Jul 31 21:38:25.918821 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:25.918780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" event={"ID":"2da406d6-b27d-4dc8-adbf-e27d945f8973","Type":"ContainerStarted","Data":"6997a6681d4ad52e49a7cecbe7050513191e080fba10ba22b04896b3f4e87602"} Jul 31 21:38:26.924303 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:26.924270 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" event={"ID":"2da406d6-b27d-4dc8-adbf-e27d945f8973","Type":"ContainerStarted","Data":"d975c66a3cd0e378418fe56b45ff9d6ff711693137a5c8704e756d939fcb0fdb"} Jul 31 21:38:26.941877 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:26.941825 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" podStartSLOduration=1.9425741479999998 podStartE2EDuration="2.941805495s" totalImagesPullingTime="999.231347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:26.940417197 +0000 UTC m=+757.975230553" watchObservedRunningTime="2026-07-31 21:38:26.941805495 +0000 UTC m=+757.976618844" Jul 31 21:38:32.936463 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:32.936434 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m"] Jul 31 21:38:32.941504 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:32.941483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:32.943754 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:32.943729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 31 21:38:32.951117 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:32.951093 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m"] Jul 31 21:38:32.979897 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:32.979875 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:33.059414 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059392 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.059526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059422 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.059526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn76f\" (UniqueName: \"kubernetes.io/projected/7b2775b4-83eb-4212-a2cd-5e9ab216a391-kube-api-access-tn76f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.059526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.059526 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.059690 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.059565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.160792 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.160896 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.160896 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn76f\" (UniqueName: \"kubernetes.io/projected/7b2775b4-83eb-4212-a2cd-5e9ab216a391-kube-api-access-tn76f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.160896 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.160896 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.161102 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.160936 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.161225 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.161203 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.161284 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.161243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.161338 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.161290 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.163270 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.163248 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b2775b4-83eb-4212-a2cd-5e9ab216a391-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.163383 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.163367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b2775b4-83eb-4212-a2cd-5e9ab216a391-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.169297 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.169279 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn76f\" (UniqueName: \"kubernetes.io/projected/7b2775b4-83eb-4212-a2cd-5e9ab216a391-kube-api-access-tn76f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nqg4m\" (UID: \"7b2775b4-83eb-4212-a2cd-5e9ab216a391\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.253161 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.253110 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:33.378110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.378058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m"] Jul 31 21:38:33.380721 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:38:33.380691 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2775b4_83eb_4212_a2cd_5e9ab216a391.slice/crio-b1e0b412410ad590cafdbb3b90a457fec4291a622e8e820f28ffb178dd35ac55 WatchSource:0}: Error finding container b1e0b412410ad590cafdbb3b90a457fec4291a622e8e820f28ffb178dd35ac55: Status 404 returned error can't find the container with id b1e0b412410ad590cafdbb3b90a457fec4291a622e8e820f28ffb178dd35ac55 Jul 31 21:38:33.951667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.951580 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" event={"ID":"7b2775b4-83eb-4212-a2cd-5e9ab216a391","Type":"ContainerStarted","Data":"65fff0db2c1e21d62d1d5dc26f978089fd54457f2365a843f570012bcb719fa9"} Jul 31 21:38:33.951667 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.951629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" event={"ID":"7b2775b4-83eb-4212-a2cd-5e9ab216a391","Type":"ContainerStarted","Data":"b1e0b412410ad590cafdbb3b90a457fec4291a622e8e820f28ffb178dd35ac55"} Jul 31 21:38:33.974220 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:33.974174 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" podStartSLOduration=1.7842647820000002 podStartE2EDuration="1.974158853s" totalImagesPullingTime="189.894071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:33.972407648 +0000 UTC m=+765.007221107" watchObservedRunningTime="2026-07-31 21:38:33.974158853 +0000 UTC m=+765.008972254" Jul 31 21:38:35.148051 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:35.148017 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:35.148529 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:35.148106 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:35.161249 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:35.161223 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:35.972195 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:35.972167 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l" Jul 31 21:38:36.046517 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.046485 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74"] Jul 31 21:38:36.049572 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.049556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.052320 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.052296 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74"] Jul 31 21:38:36.053185 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.053157 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 31 21:38:36.070691 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.070670 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:38:36.185046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqp5\" (UniqueName: \"kubernetes.io/projected/fdad87fd-c40a-4110-b86d-d70523f5fa58-kube-api-access-6zqp5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.185046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.185601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.185601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.185601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdad87fd-c40a-4110-b86d-d70523f5fa58-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.185601 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.185255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286552 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286461 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqp5\" (UniqueName: \"kubernetes.io/projected/fdad87fd-c40a-4110-b86d-d70523f5fa58-kube-api-access-6zqp5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286552 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286552 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286824 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286824 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdad87fd-c40a-4110-b86d-d70523f5fa58-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.286824 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.287044 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.286960 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.287119 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.287093 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.287292 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.287274 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.289354 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.289328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdad87fd-c40a-4110-b86d-d70523f5fa58-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.289493 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.289431 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdad87fd-c40a-4110-b86d-d70523f5fa58-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.293997 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.293968 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqp5\" (UniqueName: \"kubernetes.io/projected/fdad87fd-c40a-4110-b86d-d70523f5fa58-kube-api-access-6zqp5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-62t74\" (UID: \"fdad87fd-c40a-4110-b86d-d70523f5fa58\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.361759 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.361719 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:36.514700 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.514669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74"] Jul 31 21:38:36.517670 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:38:36.517644 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdad87fd_c40a_4110_b86d_d70523f5fa58.slice/crio-e1e18bf22ed6610cdec0d6a601e5f1da581389b40c1738224c229a7fb284269d WatchSource:0}: Error finding container e1e18bf22ed6610cdec0d6a601e5f1da581389b40c1738224c229a7fb284269d: Status 404 returned error can't find the container with id e1e18bf22ed6610cdec0d6a601e5f1da581389b40c1738224c229a7fb284269d Jul 31 21:38:36.965621 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.965584 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" event={"ID":"fdad87fd-c40a-4110-b86d-d70523f5fa58","Type":"ContainerStarted","Data":"bc8e01507eb73fa8d04d4fbf823e22e1e2abe73139e09573ef3e50d91dda8897"} Jul 31 21:38:36.965767 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.965630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" event={"ID":"fdad87fd-c40a-4110-b86d-d70523f5fa58","Type":"ContainerStarted","Data":"e1e18bf22ed6610cdec0d6a601e5f1da581389b40c1738224c229a7fb284269d"} Jul 31 21:38:36.983105 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:36.983044 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" podStartSLOduration=0.757743214 podStartE2EDuration="983.029093ms" totalImagesPullingTime="225.285879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:38:36.981605341 +0000 UTC m=+768.016418687" watchObservedRunningTime="2026-07-31 21:38:36.983029093 +0000 UTC m=+768.017842439" Jul 31 21:38:43.253244 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:43.253196 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:43.253707 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:43.253268 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:43.265164 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:43.265144 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:44.004386 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:44.004355 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nqg4m" Jul 31 21:38:46.362707 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:46.362674 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:46.363140 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:46.362722 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:46.374252 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:46.374232 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:38:47.014872 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:38:47.014849 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-62t74" Jul 31 21:39:43.614957 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.614884 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dcc86f94-thdr5"] Jul 31 21:39:43.618040 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.618025 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.631039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.631016 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcc86f94-thdr5"] Jul 31 21:39:43.680486 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.680468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8w5h\" (UniqueName: \"kubernetes.io/projected/c183ce87-230f-4de2-93eb-ee48315cf240-kube-api-access-c8w5h\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.680591 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.680506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c183ce87-230f-4de2-93eb-ee48315cf240-tls-cert\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.781484 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.781460 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8w5h\" (UniqueName: \"kubernetes.io/projected/c183ce87-230f-4de2-93eb-ee48315cf240-kube-api-access-c8w5h\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.781566 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.781505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c183ce87-230f-4de2-93eb-ee48315cf240-tls-cert\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.784212 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.784176 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c183ce87-230f-4de2-93eb-ee48315cf240-tls-cert\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.791478 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.791458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8w5h\" (UniqueName: \"kubernetes.io/projected/c183ce87-230f-4de2-93eb-ee48315cf240-kube-api-access-c8w5h\") pod \"authorino-7dcc86f94-thdr5\" (UID: \"c183ce87-230f-4de2-93eb-ee48315cf240\") " pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:43.926259 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:43.926208 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcc86f94-thdr5" Jul 31 21:39:44.046381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:44.046342 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcc86f94-thdr5"] Jul 31 21:39:44.048855 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:39:44.048818 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc183ce87_230f_4de2_93eb_ee48315cf240.slice/crio-ca3c6aed064b23d57c61e4724d79f5f76a6cc99fa316ce3ad8fe62da0221c69f WatchSource:0}: Error finding container ca3c6aed064b23d57c61e4724d79f5f76a6cc99fa316ce3ad8fe62da0221c69f: Status 404 returned error can't find the container with id ca3c6aed064b23d57c61e4724d79f5f76a6cc99fa316ce3ad8fe62da0221c69f Jul 31 21:39:44.050167 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:44.050152 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 21:39:44.221729 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:44.221642 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcc86f94-thdr5" event={"ID":"c183ce87-230f-4de2-93eb-ee48315cf240","Type":"ContainerStarted","Data":"ca3c6aed064b23d57c61e4724d79f5f76a6cc99fa316ce3ad8fe62da0221c69f"} Jul 31 21:39:45.229636 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.229542 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcc86f94-thdr5" event={"ID":"c183ce87-230f-4de2-93eb-ee48315cf240","Type":"ContainerStarted","Data":"2c1f768b77901c3faa93f1cbbfb52d8f55365bfd0b1037a9c4e185964768bd15"} Jul 31 21:39:45.247240 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.247193 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dcc86f94-thdr5" podStartSLOduration=1.467667662 podStartE2EDuration="2.247174839s" totalImagesPullingTime="779.507177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:39:45.245958756 +0000 UTC m=+836.280772102" watchObservedRunningTime="2026-07-31 21:39:45.247174839 +0000 UTC m=+836.281988187" Jul 31 21:39:45.283746 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.283704 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:39:45.284190 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.284164 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-67c45db895-vf26p" podUID="1c521b14-879c-4b9d-a14c-9b70b60aec77" containerName="authorino" containerID="cri-o://435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33" gracePeriod=30 Jul 31 21:39:45.532504 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.532479 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:39:45.597709 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.597678 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert\") pod \"1c521b14-879c-4b9d-a14c-9b70b60aec77\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " Jul 31 21:39:45.597885 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.597745 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dbm2\" (UniqueName: \"kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2\") pod \"1c521b14-879c-4b9d-a14c-9b70b60aec77\" (UID: \"1c521b14-879c-4b9d-a14c-9b70b60aec77\") " Jul 31 21:39:45.599820 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.599790 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2" (OuterVolumeSpecName: "kube-api-access-8dbm2") pod "1c521b14-879c-4b9d-a14c-9b70b60aec77" (UID: "1c521b14-879c-4b9d-a14c-9b70b60aec77"). InnerVolumeSpecName "kube-api-access-8dbm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:39:45.607477 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.607454 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1c521b14-879c-4b9d-a14c-9b70b60aec77" (UID: "1c521b14-879c-4b9d-a14c-9b70b60aec77"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:39:45.699058 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.699023 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c521b14-879c-4b9d-a14c-9b70b60aec77-tls-cert\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:39:45.699058 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.699055 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dbm2\" (UniqueName: \"kubernetes.io/projected/1c521b14-879c-4b9d-a14c-9b70b60aec77-kube-api-access-8dbm2\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:39:45.786758 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.786662 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:39:45.881805 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:45.881770 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:39:46.235131 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.235096 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c521b14-879c-4b9d-a14c-9b70b60aec77" containerID="435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33" exitCode=0 Jul 31 21:39:46.235617 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.235151 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67c45db895-vf26p" Jul 31 21:39:46.235617 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.235197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c45db895-vf26p" event={"ID":"1c521b14-879c-4b9d-a14c-9b70b60aec77","Type":"ContainerDied","Data":"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33"} Jul 31 21:39:46.235617 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.235235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67c45db895-vf26p" event={"ID":"1c521b14-879c-4b9d-a14c-9b70b60aec77","Type":"ContainerDied","Data":"80221376a325e029f8a7fa2d4d2aadcf331c0cb5f657409faff132afeff0e0db"} Jul 31 21:39:46.235617 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.235253 2577 scope.go:117] "RemoveContainer" containerID="435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33" Jul 31 21:39:46.243766 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.243750 2577 scope.go:117] "RemoveContainer" containerID="435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33" Jul 31 21:39:46.243988 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:39:46.243972 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33\": container with ID starting with 435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33 not found: ID does not exist" containerID="435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33" Jul 31 21:39:46.244031 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.243995 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33"} err="failed to get container status \"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33\": rpc error: code = NotFound desc = could not find container \"435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33\": container with ID starting with 435839d5104c9ceb5ff34b98c9fa9b5986fef6cf060fd644f1610e4dded19c33 not found: ID does not exist" Jul 31 21:39:46.266535 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.266508 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:39:46.272635 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.272608 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67c45db895-vf26p"] Jul 31 21:39:46.864506 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.864466 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:39:46.960913 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:46.960882 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:39:47.495120 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:39:47.495068 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c521b14-879c-4b9d-a14c-9b70b60aec77" path="/var/lib/kubelet/pods/1c521b14-879c-4b9d-a14c-9b70b60aec77/volumes" Jul 31 21:41:16.805823 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:41:16.805790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:41:52.922439 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:41:52.922403 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:41:54.176047 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:41:54.176014 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:42:55.094661 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:42:55.094622 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:42:55.229600 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:42:55.229569 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:42:55.343501 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:42:55.343475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:01.371512 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:01.371477 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:01.487219 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:01.487193 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:01.579061 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:01.579036 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:01.756852 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:01.756790 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:07.750788 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:07.750754 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:07.854542 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:07.854512 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:10.761712 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:10.761682 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:10.862679 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:10.862643 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:12.789822 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:12.789788 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:56.949050 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:56.948941 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:43:58.004346 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:43:58.004311 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:44:23.031066 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:44:23.031030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:49:53.720894 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:49:53.720864 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:50:29.978092 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:50:29.978040 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:53:10.019927 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:10.019890 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:53:12.836133 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.836096 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:53:12.836491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.836374 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c521b14-879c-4b9d-a14c-9b70b60aec77" containerName="authorino" Jul 31 21:53:12.836491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.836384 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c521b14-879c-4b9d-a14c-9b70b60aec77" containerName="authorino" Jul 31 21:53:12.836491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.836445 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c521b14-879c-4b9d-a14c-9b70b60aec77" containerName="authorino" Jul 31 21:53:12.839244 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.839224 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.841263 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.841241 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-461d0523-kserve-self-signed-certs\"" Jul 31 21:53:12.856316 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.856297 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:53:12.871357 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.871325 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:53:12.942566 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942535 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.942696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.942696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.942696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.942696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942653 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc2fh\" (UniqueName: \"kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:12.942696 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:12.942678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043509 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043628 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043513 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043628 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043724 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043724 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc2fh\" (UniqueName: \"kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043724 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043893 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043874 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043949 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.043998 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.043953 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.045935 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.045914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.046205 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.046190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.051279 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.051261 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc2fh\" (UniqueName: \"kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh\") pod \"e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.148091 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.148016 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:13.269037 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:13.269006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:53:13.272149 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:53:13.272113 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaffbd50_79d9_473a_8294_74638ea58ee6.slice/crio-6c55790a4bfdcde26442f790975c6b715397b913efa5cbc5680e76b697ef4687 WatchSource:0}: Error finding container 6c55790a4bfdcde26442f790975c6b715397b913efa5cbc5680e76b697ef4687: Status 404 returned error can't find the container with id 6c55790a4bfdcde26442f790975c6b715397b913efa5cbc5680e76b697ef4687 Jul 31 21:53:14.279378 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:14.279347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" event={"ID":"faffbd50-79d9-473a-8294-74638ea58ee6","Type":"ContainerStarted","Data":"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05"} Jul 31 21:53:14.279732 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:14.279389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" event={"ID":"faffbd50-79d9-473a-8294-74638ea58ee6","Type":"ContainerStarted","Data":"6c55790a4bfdcde26442f790975c6b715397b913efa5cbc5680e76b697ef4687"} Jul 31 21:53:14.295283 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:14.295239 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" podStartSLOduration=2.29522467 podStartE2EDuration="2.29522467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:53:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:53:14.293510963 +0000 UTC m=+1645.328324308" watchObservedRunningTime="2026-07-31 21:53:14.29522467 +0000 UTC m=+1645.330038017" Jul 31 21:53:16.961827 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:16.961791 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:53:16.964815 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:16.964792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:16.968316 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:16.968292 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-461d0523-kserve-self-signed-certs\"" Jul 31 21:53:16.983410 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:16.983379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:53:17.033728 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.033692 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:53:17.073775 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.073743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.073943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.073787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qn4\" (UniqueName: \"kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.073943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.073808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.073943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.073835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.073943 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.073898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.074170 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.074012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175039 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175293 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175293 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175293 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175168 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175293 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qn4\" (UniqueName: \"kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175520 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175494 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175575 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175518 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.175626 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.175603 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.177764 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.177737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.178149 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.178124 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.186723 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.186689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qn4\" (UniqueName: \"kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4\") pod \"e2e-same-id-b-461d0523-kserve-d5987b775-g6js8\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.273891 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.273804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:17.409594 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:17.409563 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:53:17.412056 ip-10-0-140-49 kubenswrapper[2577]: W0731 21:53:17.412029 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8821fb8_6805_4e9d_934e_f59e4f465580.slice/crio-da0e8aff058b696a9b16d9322f54b1312af219d7f36d71a62c50d41663481a59 WatchSource:0}: Error finding container da0e8aff058b696a9b16d9322f54b1312af219d7f36d71a62c50d41663481a59: Status 404 returned error can't find the container with id da0e8aff058b696a9b16d9322f54b1312af219d7f36d71a62c50d41663481a59 Jul 31 21:53:18.298166 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:18.298133 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" event={"ID":"a8821fb8-6805-4e9d-934e-f59e4f465580","Type":"ContainerStarted","Data":"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20"} Jul 31 21:53:18.298507 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:18.298175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" event={"ID":"a8821fb8-6805-4e9d-934e-f59e4f465580","Type":"ContainerStarted","Data":"da0e8aff058b696a9b16d9322f54b1312af219d7f36d71a62c50d41663481a59"} Jul 31 21:53:18.315777 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:18.315734 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" podStartSLOduration=2.315718251 podStartE2EDuration="2.315718251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 21:53:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 21:53:18.314668302 +0000 UTC m=+1649.349481651" watchObservedRunningTime="2026-07-31 21:53:18.315718251 +0000 UTC m=+1649.350531597" Jul 31 21:53:23.148264 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:23.148179 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:23.148264 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:23.148231 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:23.166511 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:23.166482 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:23.328423 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:23.328387 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:53:27.274182 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:27.274152 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:27.274182 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:27.274188 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:27.286098 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:27.286061 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:53:27.342256 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:53:27.342239 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:54:10.063028 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:10.062997 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:54:10.099505 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:10.099475 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:54:10.966963 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:10.966881 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:54:10.986966 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:10.986934 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:54:25.081302 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.081250 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" podUID="faffbd50-79d9-473a-8294-74638ea58ee6" containerName="main" containerID="cri-o://c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05" gracePeriod=45 Jul 31 21:54:25.318491 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.318465 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:54:25.363681 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363627 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc2fh\" (UniqueName: \"kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363776 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363685 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363776 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363721 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363776 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363750 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363776 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363771 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363967 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363804 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache\") pod \"faffbd50-79d9-473a-8294-74638ea58ee6\" (UID: \"faffbd50-79d9-473a-8294-74638ea58ee6\") " Jul 31 21:54:25.363967 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.363950 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:25.364062 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.364025 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.364062 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.364017 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home" (OuterVolumeSpecName: "home") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:25.364381 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.364196 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache" (OuterVolumeSpecName: "model-cache") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:25.365838 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.365813 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm" (OuterVolumeSpecName: "dshm") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:25.365926 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.365851 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh" (OuterVolumeSpecName: "kube-api-access-fc2fh") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "kube-api-access-fc2fh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:54:25.365963 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.365926 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "faffbd50-79d9-473a-8294-74638ea58ee6" (UID: "faffbd50-79d9-473a-8294-74638ea58ee6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:54:25.464973 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.464953 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.464973 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.464970 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.465104 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.464978 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/faffbd50-79d9-473a-8294-74638ea58ee6-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.465104 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.464987 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/faffbd50-79d9-473a-8294-74638ea58ee6-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.465104 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.464994 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc2fh\" (UniqueName: \"kubernetes.io/projected/faffbd50-79d9-473a-8294-74638ea58ee6-kube-api-access-fc2fh\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:25.559113 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.559086 2577 generic.go:356] "Generic (PLEG): container finished" podID="faffbd50-79d9-473a-8294-74638ea58ee6" containerID="c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05" exitCode=0 Jul 31 21:54:25.559209 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.559124 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" Jul 31 21:54:25.559209 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.559175 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" event={"ID":"faffbd50-79d9-473a-8294-74638ea58ee6","Type":"ContainerDied","Data":"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05"} Jul 31 21:54:25.559286 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.559215 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5" event={"ID":"faffbd50-79d9-473a-8294-74638ea58ee6","Type":"ContainerDied","Data":"6c55790a4bfdcde26442f790975c6b715397b913efa5cbc5680e76b697ef4687"} Jul 31 21:54:25.559286 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.559231 2577 scope.go:117] "RemoveContainer" containerID="c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05" Jul 31 21:54:25.566819 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.566803 2577 scope.go:117] "RemoveContainer" containerID="c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05" Jul 31 21:54:25.567031 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:54:25.567014 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05\": container with ID starting with c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05 not found: ID does not exist" containerID="c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05" Jul 31 21:54:25.567110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.567038 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05"} err="failed to get container status \"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05\": rpc error: code = NotFound desc = could not find container \"c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05\": container with ID starting with c57aad1d0ad67a2e370526428adfc2b7d015cb39a9cab08e90b333297b0d4f05 not found: ID does not exist" Jul 31 21:54:25.572613 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.572591 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:54:25.579055 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.579036 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-461d0523-kserve-cd787746c-fh8w5"] Jul 31 21:54:25.985518 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:25.985489 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" podUID="a8821fb8-6805-4e9d-934e-f59e4f465580" containerName="main" containerID="cri-o://b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20" gracePeriod=45 Jul 31 21:54:26.221328 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.221307 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:54:26.269904 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269852 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.269904 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269898 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.270046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269929 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qn4\" (UniqueName: \"kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.270046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269946 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.270046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269981 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.270046 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.269995 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home\") pod \"a8821fb8-6805-4e9d-934e-f59e4f465580\" (UID: \"a8821fb8-6805-4e9d-934e-f59e4f465580\") " Jul 31 21:54:26.270265 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.270130 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:26.270327 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.270304 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-model-cache\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.270380 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.270339 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home" (OuterVolumeSpecName: "home") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:26.270380 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.270353 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:26.272060 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.272033 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4" (OuterVolumeSpecName: "kube-api-access-h9qn4") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "kube-api-access-h9qn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 21:54:26.272182 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.272092 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 21:54:26.272182 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.272095 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm" (OuterVolumeSpecName: "dshm") pod "a8821fb8-6805-4e9d-934e-f59e4f465580" (UID: "a8821fb8-6805-4e9d-934e-f59e4f465580"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 21:54:26.370978 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.370960 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8821fb8-6805-4e9d-934e-f59e4f465580-tls-certs\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.370978 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.370977 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qn4\" (UniqueName: \"kubernetes.io/projected/a8821fb8-6805-4e9d-934e-f59e4f465580-kube-api-access-h9qn4\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.371119 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.370986 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-dshm\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.371119 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.370994 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-tmp-dir\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.371119 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.371001 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8821fb8-6805-4e9d-934e-f59e4f465580-home\") on node \"ip-10-0-140-49.ec2.internal\" DevicePath \"\"" Jul 31 21:54:26.563929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.563871 2577 generic.go:356] "Generic (PLEG): container finished" podID="a8821fb8-6805-4e9d-934e-f59e4f465580" containerID="b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20" exitCode=0 Jul 31 21:54:26.563929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.563909 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" Jul 31 21:54:26.563929 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.563915 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" event={"ID":"a8821fb8-6805-4e9d-934e-f59e4f465580","Type":"ContainerDied","Data":"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20"} Jul 31 21:54:26.564110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.563956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8" event={"ID":"a8821fb8-6805-4e9d-934e-f59e4f465580","Type":"ContainerDied","Data":"da0e8aff058b696a9b16d9322f54b1312af219d7f36d71a62c50d41663481a59"} Jul 31 21:54:26.564110 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.563976 2577 scope.go:117] "RemoveContainer" containerID="b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20" Jul 31 21:54:26.572058 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.572044 2577 scope.go:117] "RemoveContainer" containerID="b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20" Jul 31 21:54:26.572353 ip-10-0-140-49 kubenswrapper[2577]: E0731 21:54:26.572336 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20\": container with ID starting with b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20 not found: ID does not exist" containerID="b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20" Jul 31 21:54:26.572401 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.572361 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20"} err="failed to get container status \"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20\": rpc error: code = NotFound desc = could not find container \"b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20\": container with ID starting with b5b57eade1a96d8fd067081782360c18cd44cbf52aab964bcf2ed858e6e84f20 not found: ID does not exist" Jul 31 21:54:26.581510 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.581489 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:54:26.585803 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:26.585785 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-461d0523-kserve-d5987b775-g6js8"] Jul 31 21:54:27.494155 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:27.494127 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8821fb8-6805-4e9d-934e-f59e4f465580" path="/var/lib/kubelet/pods/a8821fb8-6805-4e9d-934e-f59e4f465580/volumes" Jul 31 21:54:27.494493 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:54:27.494461 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faffbd50-79d9-473a-8294-74638ea58ee6" path="/var/lib/kubelet/pods/faffbd50-79d9-473a-8294-74638ea58ee6/volumes" Jul 31 21:57:17.344134 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:57:17.344030 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:57:18.770653 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:57:18.770623 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:57:29.677400 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:57:29.677358 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 21:57:55.429874 ip-10-0-140-49 kubenswrapper[2577]: I0731 21:57:55.429842 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:00:42.338870 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:00:42.338794 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:00:42.427695 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:00:42.427665 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:02:14.202205 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:02:14.202166 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:02:15.877047 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:02:15.876997 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:06:14.784506 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:06:14.784414 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:06:36.514372 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:06:36.514331 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:06.113095 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:06.113041 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:06.212448 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:06.212417 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:06.573454 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:06.573430 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:12.604376 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:12.604339 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:12.677568 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:12.677538 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:12.842573 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:12.842534 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:13.144037 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:13.144003 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:13.257218 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:13.257185 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:19.001942 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:19.001906 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:19.103802 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:19.103766 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:20.226180 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:20.226145 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:20.686092 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:20.686034 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:20.790347 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:20.790314 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:08:20.885003 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:08:20.884967 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:10:30.811892 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:10:30.811839 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:10:53.590396 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:10:53.590303 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:11:26.840168 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:26.840134 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:11:27.873633 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:27.873605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dcc86f94-thdr5_c183ce87-230f-4de2-93eb-ee48315cf240/authorino/0.log" Jul 31 22:11:28.229207 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:28.229114 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:11:33.081335 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:33.081293 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g7vm2_3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9/manager/0.log" Jul 31 22:11:33.530275 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:33.530192 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-6bxdd_8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca/copy-manifests/0.log" Jul 31 22:11:33.541845 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:33.541816 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-6bxdd_8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca/manager/0.log" Jul 31 22:11:35.181134 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:35.181098 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dcc86f94-thdr5_c183ce87-230f-4de2-93eb-ee48315cf240/authorino/0.log" Jul 31 22:11:35.500409 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:35.500334 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-gthrr_37dbc045-c78e-4984-811d-79f1a6615eb9/kuadrant-console-plugin/0.log" Jul 31 22:11:36.396459 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:36.396420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-htnsm_5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0/kube-auth-proxy/0.log" Jul 31 22:11:37.618614 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:37.618583 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fg8d7l_2da406d6-b27d-4dc8-adbf-e27d945f8973/main/0.log" Jul 31 22:11:37.731474 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:37.731451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nqg4m_7b2775b4-83eb-4212-a2cd-5e9ab216a391/main/0.log" Jul 31 22:11:37.841976 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:37.841954 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-62t74_fdad87fd-c40a-4110-b86d-d70523f5fa58/main/0.log" Jul 31 22:11:42.864982 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.864944 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5gz77/must-gather-fl8gq"] Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865251 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faffbd50-79d9-473a-8294-74638ea58ee6" containerName="main" Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865264 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="faffbd50-79d9-473a-8294-74638ea58ee6" containerName="main" Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865282 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8821fb8-6805-4e9d-934e-f59e4f465580" containerName="main" Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865288 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8821fb8-6805-4e9d-934e-f59e4f465580" containerName="main" Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865339 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="faffbd50-79d9-473a-8294-74638ea58ee6" containerName="main" Jul 31 22:11:42.865390 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.865347 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8821fb8-6805-4e9d-934e-f59e4f465580" containerName="main" Jul 31 22:11:42.868343 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.868325 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:42.870259 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.870237 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5gz77\"/\"default-dockercfg-67wlj\"" Jul 31 22:11:42.871113 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.871063 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gz77\"/\"kube-root-ca.crt\"" Jul 31 22:11:42.871244 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.871123 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5gz77\"/\"openshift-service-ca.crt\"" Jul 31 22:11:42.879241 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.879220 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/must-gather-fl8gq"] Jul 31 22:11:42.893706 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.893685 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:11:42.978698 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.978676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wst8\" (UniqueName: \"kubernetes.io/projected/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-kube-api-access-7wst8\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:42.978819 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.978738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-must-gather-output\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:42.993803 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:42.993781 2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" limit=1024 Jul 31 22:11:43.079285 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.079265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wst8\" (UniqueName: \"kubernetes.io/projected/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-kube-api-access-7wst8\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:43.079373 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.079308 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-must-gather-output\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:43.079579 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.079565 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-must-gather-output\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:43.086861 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.086844 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wst8\" (UniqueName: \"kubernetes.io/projected/c22c3c3b-dab2-4c76-b15a-8e03beeed9cb-kube-api-access-7wst8\") pod \"must-gather-fl8gq\" (UID: \"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb\") " pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:43.178047 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.177995 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/must-gather-fl8gq" Jul 31 22:11:43.307324 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.307286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/must-gather-fl8gq"] Jul 31 22:11:43.310020 ip-10-0-140-49 kubenswrapper[2577]: W0731 22:11:43.309992 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc22c3c3b_dab2_4c76_b15a_8e03beeed9cb.slice/crio-02fe2e5a5dab8bf613d3ac6af24d8d8d17213089d5220cbdbb5363b68ee2f4ef WatchSource:0}: Error finding container 02fe2e5a5dab8bf613d3ac6af24d8d8d17213089d5220cbdbb5363b68ee2f4ef: Status 404 returned error can't find the container with id 02fe2e5a5dab8bf613d3ac6af24d8d8d17213089d5220cbdbb5363b68ee2f4ef Jul 31 22:11:43.311990 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.311973 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 22:11:43.527614 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:43.527549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/must-gather-fl8gq" event={"ID":"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb","Type":"ContainerStarted","Data":"02fe2e5a5dab8bf613d3ac6af24d8d8d17213089d5220cbdbb5363b68ee2f4ef"} Jul 31 22:11:44.535993 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:44.535888 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/must-gather-fl8gq" event={"ID":"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb","Type":"ContainerStarted","Data":"09b282ab2bec3f9fe0fbaf22bbf9a088f4ec4c299a3d1177a16773b0de71e82f"} Jul 31 22:11:44.535993 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:44.535938 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/must-gather-fl8gq" event={"ID":"c22c3c3b-dab2-4c76-b15a-8e03beeed9cb","Type":"ContainerStarted","Data":"7577d18d632e5b876f7eec361c22727f3f7e4a0e3cc32300c50347b3384d7072"} Jul 31 22:11:45.797887 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:45.797851 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-czpdq_0ec78100-b077-4d5f-8ba9-68c8e8543ec9/global-pull-secret-syncer/0.log" Jul 31 22:11:45.940881 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:45.940853 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gnx74_01da8896-fa0c-45f0-bdf5-4947dc1a79f7/konnectivity-agent/0.log" Jul 31 22:11:46.073313 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:46.073286 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-49.ec2.internal_979a16b3deb9fd23e3efb2e6d72ea3f8/haproxy/0.log" Jul 31 22:11:50.653314 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:50.653278 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7dcc86f94-thdr5_c183ce87-230f-4de2-93eb-ee48315cf240/authorino/0.log" Jul 31 22:11:50.760457 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:50.760420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-gthrr_37dbc045-c78e-4984-811d-79f1a6615eb9/kuadrant-console-plugin/0.log" Jul 31 22:11:52.914597 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:52.914570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/node-exporter/0.log" Jul 31 22:11:52.951214 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:52.951188 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/kube-rbac-proxy/0.log" Jul 31 22:11:52.976048 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:52.976019 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcgjt_3ed95dfd-050e-419e-a360-42a5a17fdbce/init-textfile/0.log" Jul 31 22:11:55.756000 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.755933 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5gz77/must-gather-fl8gq" podStartSLOduration=12.833940934 podStartE2EDuration="13.755907317s" totalImagesPullingTime="921.966383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 22:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:11:44.55260071 +0000 UTC m=+2755.587414058" watchObservedRunningTime="2026-07-31 22:11:55.755907317 +0000 UTC m=+2766.790720666" Jul 31 22:11:55.758022 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.757989 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv"] Jul 31 22:11:55.765533 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.765508 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:55.771781 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.771750 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv"] Jul 31 22:11:55.909134 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.909096 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-lib-modules\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:55.909391 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.909367 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pk5c\" (UniqueName: \"kubernetes.io/projected/0badb049-b937-482f-aa7b-d4afceafe3bc-kube-api-access-6pk5c\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:55.909579 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.909559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-sys\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:55.909692 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.909678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-proc\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:55.909834 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:55.909819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-podres\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.010444 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-podres\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.010836 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010812 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-lib-modules\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.010927 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010853 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pk5c\" (UniqueName: \"kubernetes.io/projected/0badb049-b937-482f-aa7b-d4afceafe3bc-kube-api-access-6pk5c\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.010968 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010930 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-sys\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.010968 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010956 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-proc\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.011036 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.011026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-proc\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.011091 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.010743 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-podres\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.011167 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.011147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-lib-modules\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.011254 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.011228 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0badb049-b937-482f-aa7b-d4afceafe3bc-sys\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.019494 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.019468 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pk5c\" (UniqueName: \"kubernetes.io/projected/0badb049-b937-482f-aa7b-d4afceafe3bc-kube-api-access-6pk5c\") pod \"perf-node-gather-daemonset-szxsv\" (UID: \"0badb049-b937-482f-aa7b-d4afceafe3bc\") " pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.079220 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.079184 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:56.258630 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.258570 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv"] Jul 31 22:11:56.261970 ip-10-0-140-49 kubenswrapper[2577]: W0731 22:11:56.261917 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0badb049_b937_482f_aa7b_d4afceafe3bc.slice/crio-d5ae830e4463889cfc84ac68b9e46a878e5a9dce1a31047c16d85000cf02605f WatchSource:0}: Error finding container d5ae830e4463889cfc84ac68b9e46a878e5a9dce1a31047c16d85000cf02605f: Status 404 returned error can't find the container with id d5ae830e4463889cfc84ac68b9e46a878e5a9dce1a31047c16d85000cf02605f Jul 31 22:11:56.612922 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.612863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" event={"ID":"0badb049-b937-482f-aa7b-d4afceafe3bc","Type":"ContainerStarted","Data":"0d4edf0111ec20264a6a4b9e1d82a65e29cc5cba9546feb26f9c24bd0678fea4"} Jul 31 22:11:56.613136 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.612975 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" event={"ID":"0badb049-b937-482f-aa7b-d4afceafe3bc","Type":"ContainerStarted","Data":"d5ae830e4463889cfc84ac68b9e46a878e5a9dce1a31047c16d85000cf02605f"} Jul 31 22:11:56.613136 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:56.613106 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:11:58.043005 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.042980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cj8m_dc9a62f7-179b-4d06-bb33-55ddb877309c/dns/0.log" Jul 31 22:11:58.065991 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.065960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6cj8m_dc9a62f7-179b-4d06-bb33-55ddb877309c/kube-rbac-proxy/0.log" Jul 31 22:11:58.216167 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.216139 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t7kr_983f31b7-20cb-419b-a8da-8df93782f855/dns-node-resolver/0.log" Jul 31 22:11:58.753212 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.753182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5b46758-d44vj_a79fd068-499f-4b96-b4ea-724836ae3c45/registry/0.log" Jul 31 22:11:58.764988 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.764964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c5b46758-d44vj_a79fd068-499f-4b96-b4ea-724836ae3c45/registry/1.log" Jul 31 22:11:58.815534 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:58.815505 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nv8mg_3107df97-0e95-41e3-b302-4894a421b2ef/node-ca/0.log" Jul 31 22:11:59.854026 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:11:59.853993 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-htnsm_5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0/kube-auth-proxy/0.log" Jul 31 22:12:00.661765 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:00.661731 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2dmlr_7e64472c-1ae0-48a9-a87f-6bc03d6667ba/serve-healthcheck-canary/0.log" Jul 31 22:12:01.191843 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:01.191806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpp56_57477744-559e-4f22-b4ca-0aae08f3e85b/kube-rbac-proxy/0.log" Jul 31 22:12:01.214912 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:01.214888 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpp56_57477744-559e-4f22-b4ca-0aae08f3e85b/exporter/0.log" Jul 31 22:12:01.239001 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:01.238980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cpp56_57477744-559e-4f22-b4ca-0aae08f3e85b/extractor/0.log" Jul 31 22:12:02.631132 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:02.631099 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" Jul 31 22:12:02.649227 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:02.649171 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5gz77/perf-node-gather-daemonset-szxsv" podStartSLOduration=7.64915008 podStartE2EDuration="7.64915008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 22:11:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 22:11:56.629318421 +0000 UTC m=+2767.664131771" watchObservedRunningTime="2026-07-31 22:12:02.64915008 +0000 UTC m=+2773.683963430" Jul 31 22:12:03.570177 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:03.570144 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g7vm2_3e8ce4b6-c5b1-45b9-ae5c-dbd4855082a9/manager/0.log" Jul 31 22:12:03.860612 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:03.860540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-6bxdd_8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca/manager/0.log" Jul 31 22:12:03.878721 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:03.878687 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b88b5667d-6bxdd_8a80db7d-c5ad-4126-a370-7b6c4fe9c2ca/copy-manifests/0.log" Jul 31 22:12:05.401227 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:05.401197 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5579c9d97f-sfrfn_8dca126c-8746-4c13-aa95-10ee64d7d87d/manager/0.log" Jul 31 22:12:06.127172 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:06.127143 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-htnsm_5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0/kube-auth-proxy/0.log" Jul 31 22:12:07.418790 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:07.418767 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d77494cc5-htnsm_5ccd05e2-e7f7-49c4-b95b-5dc5c3e260c0/kube-auth-proxy/0.log" Jul 31 22:12:11.981239 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:11.981151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/kube-multus-additional-cni-plugins/0.log" Jul 31 22:12:12.004139 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.004113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/egress-router-binary-copy/0.log" Jul 31 22:12:12.027121 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.027091 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/cni-plugins/0.log" Jul 31 22:12:12.049435 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.049411 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/bond-cni-plugin/0.log" Jul 31 22:12:12.071571 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.071545 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/routeoverride-cni/0.log" Jul 31 22:12:12.094206 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.094183 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/whereabouts-cni-bincopy/0.log" Jul 31 22:12:12.116743 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.116726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hhz2d_2e72a14a-31c0-4dc7-8e11-f612effff4f9/whereabouts-cni/0.log" Jul 31 22:12:12.398702 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.398673 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vmx9l_8bae9852-e9ac-4f35-8756-55bb02bb6208/kube-multus/0.log" Jul 31 22:12:12.529784 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.529756 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdfgj_6d0639ec-9830-4982-84f9-8f6abff88ca4/network-metrics-daemon/0.log" Jul 31 22:12:12.551725 ip-10-0-140-49 kubenswrapper[2577]: I0731 22:12:12.551695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdfgj_6d0639ec-9830-4982-84f9-8f6abff88ca4/kube-rbac-proxy/0.log"