Jun 10 18:58:56.928900 ip-10-0-143-152 systemd[1]: Starting Kubernetes Kubelet... Jun 10 18:58:57.324213 ip-10-0-143-152 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:58:57.324213 ip-10-0-143-152 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 18:58:57.324213 ip-10-0-143-152 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:58:57.324213 ip-10-0-143-152 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 18:58:57.324942 ip-10-0-143-152 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:58:57.326207 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.326105 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 18:58:57.331599 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331570 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.331599 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331599 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331604 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331607 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331610 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331613 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331616 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331619 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331622 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331626 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331629 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331633 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331635 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331639 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331641 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331644 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331647 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.331674 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.331658 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.332166 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332157 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.332166 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332165 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332169 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332172 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332176 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332179 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332182 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332185 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332187 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332190 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332193 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332196 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332199 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332201 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332204 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332206 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332210 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332213 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332215 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332220 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.332217 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332225 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332228 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332231 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332234 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332238 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332242 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332245 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332248 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332251 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332254 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332256 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332259 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332261 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332266 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332270 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332273 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332276 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332278 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332281 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.332689 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332283 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332286 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332288 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332291 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332293 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332296 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332299 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332301 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332304 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332306 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332309 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332312 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332314 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332317 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332323 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332327 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332329 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332332 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332335 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332338 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.333199 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332340 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332343 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332346 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332356 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332359 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332361 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332364 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332366 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332369 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332372 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332374 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332377 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332379 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332382 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332384 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332387 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332389 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332392 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332394 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332397 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.333697 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332399 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.332402 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333169 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333177 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333179 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333182 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333185 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333197 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333200 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333203 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333206 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333209 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333212 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333215 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333217 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333220 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333223 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333227 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333231 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.334179 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333234 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333237 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333240 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333242 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333245 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333247 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333250 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333252 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333255 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333257 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333260 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333263 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333265 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333268 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333271 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333274 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333277 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333280 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333282 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333285 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.334663 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333288 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333292 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333295 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333298 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333301 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333304 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333307 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333309 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333311 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333314 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333317 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333319 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333322 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333324 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333327 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333329 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333332 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333334 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333337 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333339 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.335157 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333342 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333345 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333347 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333350 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333354 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333357 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333359 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333362 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333364 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333366 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333369 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333372 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333375 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333378 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333381 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333384 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333387 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333390 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333393 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333396 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.335668 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333399 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333401 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333404 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333407 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333409 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333412 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333414 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333417 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333420 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333425 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333428 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333430 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333433 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333437 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333441 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333444 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333448 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333450 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333453 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.336165 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333456 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333458 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333461 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333952 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333958 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333962 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333966 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333969 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333973 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333975 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333978 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333980 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333983 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333986 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333989 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333993 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333996 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.333998 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334001 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334003 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.336727 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334009 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334011 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334014 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334016 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334019 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334022 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334024 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334028 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334032 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334035 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334038 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334041 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334043 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334046 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334049 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334051 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334054 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334057 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334060 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.337236 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334063 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334066 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334069 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334071 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334074 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334077 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334080 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334082 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334085 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334087 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334091 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334093 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334096 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334101 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334104 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334106 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334109 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334111 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334114 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334116 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.337720 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334119 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334121 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334124 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334127 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334129 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334132 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334134 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334136 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334139 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334142 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334145 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334148 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334152 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334154 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334157 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334160 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334162 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334165 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334168 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.338213 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334170 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334172 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334175 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334178 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334180 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334185 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334190 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334193 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334196 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334198 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334201 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334203 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334206 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334208 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334211 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334213 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334216 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334219 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334221 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.338716 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334224 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334226 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334229 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334231 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334238 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334307 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334316 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334323 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334328 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334333 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334337 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334341 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334346 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334349 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334352 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334356 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334359 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334362 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334366 2580 flags.go:64] FLAG: --cgroup-root="" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334369 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334372 2580 flags.go:64] FLAG: --client-ca-file="" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334375 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334378 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 18:58:57.339177 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334382 2580 flags.go:64] FLAG: --cluster-domain="" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334385 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334388 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334391 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334395 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334399 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334402 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334405 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334408 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334411 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334414 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334417 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334421 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334425 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334430 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334433 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334438 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334444 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334448 2580 flags.go:64] FLAG: --enable-server="true" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334453 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334459 2580 flags.go:64] FLAG: --event-burst="100" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334462 2580 flags.go:64] FLAG: --event-qps="50" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334466 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334469 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 18:58:57.339756 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334472 2580 flags.go:64] FLAG: --eviction-hard="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334476 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334479 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334482 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334485 2580 flags.go:64] FLAG: --eviction-soft="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334489 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334491 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334495 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334497 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334500 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334503 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334506 2580 flags.go:64] FLAG: --feature-gates="" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334511 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334514 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334517 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334520 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334523 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334526 2580 flags.go:64] FLAG: --help="false" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334529 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334533 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334536 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334540 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334543 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 18:58:57.340340 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334547 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334550 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334553 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334556 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334559 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334563 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334566 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334569 2580 flags.go:64] FLAG: --kube-reserved="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334572 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334575 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334592 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334595 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334598 2580 flags.go:64] FLAG: --lock-file="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334601 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334604 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334607 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334613 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334616 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334618 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334621 2580 flags.go:64] FLAG: --logging-format="text" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334624 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334628 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334631 2580 flags.go:64] FLAG: --manifest-url="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334634 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334639 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 18:58:57.341014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334642 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334646 2580 flags.go:64] FLAG: --max-pods="110" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334649 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334652 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334655 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334660 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334663 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334667 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334670 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334677 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334680 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334684 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334687 2580 flags.go:64] FLAG: --pod-cidr="" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334690 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334696 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334699 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334702 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334705 2580 flags.go:64] FLAG: --port="10250" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334708 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334711 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01fbabef946d6ae3b" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334716 2580 flags.go:64] FLAG: --qos-reserved="" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334719 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334722 2580 flags.go:64] FLAG: --register-node="true" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334725 2580 flags.go:64] FLAG: --register-with-taints="" Jun 10 18:58:57.341647 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334729 2580 flags.go:64] FLAG: --registry-burst="10" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334732 2580 flags.go:64] FLAG: --registry-qps="5" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334735 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334738 2580 flags.go:64] FLAG: --reserved-memory="" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334742 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334745 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334748 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334751 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334754 2580 flags.go:64] FLAG: --runonce="false" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334757 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334760 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334763 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334766 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334769 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334773 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334776 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334779 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334782 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334785 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334788 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334791 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334794 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334798 2580 flags.go:64] FLAG: --system-cgroups="" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334800 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334806 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 18:58:57.342271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334809 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334811 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334815 2580 flags.go:64] FLAG: --tls-min-version="" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334819 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334822 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334825 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334828 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334831 2580 flags.go:64] FLAG: --v="2" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334835 2580 flags.go:64] FLAG: --version="false" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334839 2580 flags.go:64] FLAG: --vmodule="" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334843 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.334846 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334972 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334976 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334980 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334983 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334986 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334989 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334991 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334994 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334996 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.334999 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.342890 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335002 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335005 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335008 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335011 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335013 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335016 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335019 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335022 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335025 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335028 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335031 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335033 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335036 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335040 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335043 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335046 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335048 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335051 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335054 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335057 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.343436 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335059 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335062 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335065 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335067 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335070 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335072 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335075 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335077 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335080 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335083 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335085 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335088 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335091 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335093 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335097 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335101 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335104 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335107 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335110 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335113 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.344191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335115 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335119 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335121 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335124 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335126 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335130 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335133 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335136 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335138 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335140 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335143 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335146 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335148 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335151 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335153 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335156 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335158 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335161 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335164 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335167 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.344960 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335169 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335172 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335175 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335179 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335182 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335184 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335187 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335189 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335192 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335195 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335197 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335200 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335202 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335205 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335209 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335212 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335214 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335218 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335221 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.345457 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335223 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335227 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335230 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335233 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335236 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335239 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335241 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335244 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335246 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.335249 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.336071 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.342770 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.342788 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.342808 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 18:58:57.345948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.342814 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342873 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342878 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342881 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342884 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342887 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342890 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342893 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342897 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342902 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342905 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342908 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342911 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342913 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342917 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342922 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342925 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342928 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342931 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.346299 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342934 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342937 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342940 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342943 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342945 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342948 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342951 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342953 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342956 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342959 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342962 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342966 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342969 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342972 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342975 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342978 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342980 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342983 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342985 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342988 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.346783 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342990 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342993 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342996 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.342998 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343002 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343006 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343009 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343012 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343015 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343018 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343020 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343023 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343026 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343029 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343031 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343034 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343037 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343039 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343042 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.347272 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343044 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343047 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343049 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343052 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343055 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343059 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343061 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343064 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343066 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343069 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343072 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343075 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343077 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343080 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343082 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343085 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343087 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343090 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343092 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343095 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.347765 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343097 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343100 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343103 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343105 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343108 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343110 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343113 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343116 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343118 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343121 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343123 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343130 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343132 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343135 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343138 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343141 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343143 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343146 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343149 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343151 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.348288 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343154 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343157 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.343162 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343299 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343305 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343308 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343311 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343314 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343316 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343319 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343322 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343324 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343327 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343329 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343332 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:58:57.348792 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343335 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343337 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343340 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343342 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343345 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343348 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343351 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343353 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343356 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343358 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343361 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343363 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343366 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343369 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343371 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343374 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343377 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343380 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343382 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343385 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:58:57.349163 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343387 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343390 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343393 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343395 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343398 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343401 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343403 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343405 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343408 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343412 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343416 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343419 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343422 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343424 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343427 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343430 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343432 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343435 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343438 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:58:57.349665 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343441 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343445 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343447 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343450 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343453 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343455 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343458 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343460 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343463 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343465 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343468 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343471 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343473 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343476 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343478 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343480 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343483 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343485 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343488 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343490 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:58:57.350118 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343493 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343496 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343498 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343501 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343504 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343506 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343509 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343511 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343513 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343516 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343518 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343521 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343523 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343526 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343528 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343531 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343533 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343536 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343543 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:58:57.350616 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343545 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343549 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343552 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343556 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343559 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343562 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343564 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343567 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:57.343570 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.343575 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.344430 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.346773 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.348325 2580 server.go:1019] "Starting client certificate rotation" Jun 10 18:58:57.351098 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.348425 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 18:58:57.351430 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.348456 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 18:58:57.351430 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.351085 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 18:58:57.352363 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.352346 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 18:58:57.361135 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.361115 2580 log.go:25] "Validated CRI v1 runtime API" Jun 10 18:58:57.363720 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.363707 2580 log.go:25] "Validated CRI v1 image API" Jun 10 18:58:57.364517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.364483 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 18:58:57.369246 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.369218 2580 fs.go:135] Filesystem UUIDs: map[4d892050-805e-4e11-b9e6-4d0255b4545f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7b4a2545-358a-43c8-98a0-0020f8566304:/dev/nvme0n1p4] Jun 10 18:58:57.369321 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.369243 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 18:58:57.375499 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.375375 2580 manager.go:216] Machine: {Timestamp:2026-06-10 18:58:57.373024609 +0000 UTC m=+0.327989539 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097899 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2677c0acd56f048d5cd90c0e90c332 SystemUUID:ec2677c0-acd5-6f04-8d5c-d90c0e90c332 BootID:19faac32-59c0-4223-860b-ad004d818d73 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:06:56:c5:b1:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:06:56:c5:b1:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:ac:4f:83:49:96 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 18:58:57.375499 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.375493 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 18:58:57.375635 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.375600 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 18:58:57.378944 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.378862 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 18:58:57.379318 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.378950 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 18:58:57.380639 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.380452 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 18:58:57.380698 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.380647 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 18:58:57.380698 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.380668 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 18:58:57.381397 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.381383 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 18:58:57.382235 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.382225 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 18:58:57.384680 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.384662 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 18:58:57.385299 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385287 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 18:58:57.385432 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385421 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 18:58:57.385472 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385454 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 10 18:58:57.385472 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385464 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 18:58:57.385550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385483 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 18:58:57.385550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385493 2580 kubelet.go:398] "Adding apiserver pod source" Jun 10 18:58:57.385550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385502 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 18:58:57.385939 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385925 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 18:58:57.385994 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.385948 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 18:58:57.388770 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.388752 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 18:58:57.390302 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.390202 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 18:58:57.390302 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.390237 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 18:58:57.391261 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391248 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391266 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391272 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391277 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391286 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391291 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391299 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 18:58:57.391305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391304 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 18:58:57.391479 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391312 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 18:58:57.391479 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391318 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 18:58:57.391479 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391327 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 18:58:57.391479 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391332 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 18:58:57.391967 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391957 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 18:58:57.391967 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.391967 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 18:58:57.395292 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.395277 2580 server.go:1268] "Started kubelet" Jun 10 18:58:57.395392 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.395360 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 18:58:57.395467 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.395421 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 18:58:57.395505 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.395495 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 18:58:57.396302 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.396280 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 18:58:57.396408 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.396300 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 18:58:57.396408 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.396352 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 18:58:57.396354 ip-10-0-143-152 systemd[1]: Started Kubernetes Kubelet. Jun 10 18:58:57.397282 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.397265 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 18:58:57.397850 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.397832 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 10 18:58:57.401262 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.400224 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-152.ec2.internal.18b7cd53c9852438 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-152.ec2.internal,UID:ip-10-0-143-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-152.ec2.internal,},FirstTimestamp:2026-06-10 18:58:57.395246136 +0000 UTC m=+0.350211066,LastTimestamp:2026-06-10 18:58:57.395246136 +0000 UTC m=+0.350211066,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-152.ec2.internal,}" Jun 10 18:58:57.402825 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.402806 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 18:58:57.404858 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.404838 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 18:58:57.404960 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.404857 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 18:58:57.404960 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.404920 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.405491 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405471 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 18:58:57.405491 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405479 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 18:58:57.405491 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405491 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 18:58:57.405679 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405608 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 10 18:58:57.405679 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405616 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 10 18:58:57.405768 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405680 2580 factory.go:55] Registering systemd factory Jun 10 18:58:57.405768 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.405693 2580 factory.go:223] Registration of the systemd container factory successfully Jun 10 18:58:57.406052 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406036 2580 factory.go:153] Registering CRI-O factory Jun 10 18:58:57.406052 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406054 2580 factory.go:223] Registration of the crio container factory successfully Jun 10 18:58:57.406173 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406117 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 18:58:57.406173 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406141 2580 factory.go:103] Registering Raw factory Jun 10 18:58:57.406173 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406155 2580 manager.go:1196] Started watching for new ooms in manager Jun 10 18:58:57.406891 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.406877 2580 manager.go:349] Starting recovery of all containers Jun 10 18:58:57.407223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.407191 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 18:58:57.407399 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.407378 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 18:58:57.418416 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.418278 2580 manager.go:354] Recovery completed Jun 10 18:58:57.423172 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.423153 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.425548 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.425528 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.425659 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.425562 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.425659 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.425573 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.426170 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.426152 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 18:58:57.426170 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.426170 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 18:58:57.426283 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.426158 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.426283 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.426201 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 10 18:58:57.427000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.426986 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.427062 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.427013 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.427062 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.427023 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.427715 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.427703 2580 policy_none.go:49] "None policy: Start" Jun 10 18:58:57.427764 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.427720 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 18:58:57.427764 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.427731 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 18:58:57.428791 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.428780 2580 policy_none.go:47] "Start" Jun 10 18:58:57.437043 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.436963 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-152.ec2.internal.18b7cd53cb53838e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-152.ec2.internal,UID:ip-10-0-143-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-152.ec2.internal,},FirstTimestamp:2026-06-10 18:58:57.425548174 +0000 UTC m=+0.380513104,LastTimestamp:2026-06-10 18:58:57.425548174 +0000 UTC m=+0.380513104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-152.ec2.internal,}" Jun 10 18:58:57.445131 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.445108 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vt94g" Jun 10 18:58:57.450741 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.450665 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-152.ec2.internal.18b7cd53cb53ce97 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-152.ec2.internal,UID:ip-10-0-143-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-152.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-152.ec2.internal,},FirstTimestamp:2026-06-10 18:58:57.425567383 +0000 UTC m=+0.380532313,LastTimestamp:2026-06-10 18:58:57.425567383 +0000 UTC m=+0.380532313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-152.ec2.internal,}" Jun 10 18:58:57.453817 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.453795 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vt94g" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.467553 2580 manager.go:337] "Starting Device Plugin manager" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.467608 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.467626 2580 server.go:87] "Starting device plugin registration server" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.467955 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.467970 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.468120 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.468209 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.468217 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.468841 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 18:58:57.477431 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.468888 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.477883 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.477859 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 18:58:57.479034 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.479011 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 18:58:57.479142 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.479053 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 18:58:57.479142 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.479077 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 18:58:57.479142 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.479121 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 18:58:57.481347 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.481326 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:58:57.568496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.568473 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.569534 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.569510 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.569606 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.569547 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.569606 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.569560 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.569606 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.569598 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.578879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.578824 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.578879 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.578853 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-152.ec2.internal\": node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.579707 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.579691 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal"] Jun 10 18:58:57.579772 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.579760 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.581966 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.581942 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.582071 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.581986 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.582071 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.582000 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.583453 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.583438 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.583600 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.583568 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.583641 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.583629 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.584334 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.584319 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.584409 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.584343 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.584409 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.584352 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.584983 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.584959 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.585048 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.584996 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.585048 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.585014 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.586376 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.586361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.586420 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.586403 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:57.587283 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.587257 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:57.587370 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.587290 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:57.587370 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.587308 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:57.606482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.606446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.612516 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.612492 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-152.ec2.internal\" not found" node="ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.616445 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.616422 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.617530 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.617511 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-152.ec2.internal\" not found" node="ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.707411 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.707370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.707411 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.707412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.707667 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.707432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283531b98bcf29a0a103f2206962df28-config\") pod \"kube-apiserver-proxy-ip-10-0-143-152.ec2.internal\" (UID: \"283531b98bcf29a0a103f2206962df28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.707667 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.707471 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.716563 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.716533 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.808398 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.808362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.808398 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.808401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283531b98bcf29a0a103f2206962df28-config\") pod \"kube-apiserver-proxy-ip-10-0-143-152.ec2.internal\" (UID: \"283531b98bcf29a0a103f2206962df28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.808601 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.808448 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0188c9bab58f2eae0db6ef8c05f5cd2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal\" (UID: \"0188c9bab58f2eae0db6ef8c05f5cd2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.808601 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.808489 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283531b98bcf29a0a103f2206962df28-config\") pod \"kube-apiserver-proxy-ip-10-0-143-152.ec2.internal\" (UID: \"283531b98bcf29a0a103f2206962df28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.817487 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.817457 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.917430 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.917338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:57.918417 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:57.918398 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:57.922108 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:57.922091 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:58.019272 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.019226 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.119822 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.119785 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.216875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.216795 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:58:58.220849 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.220823 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.321396 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.321358 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.347550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.347510 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 18:58:58.348240 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.347713 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 18:58:58.348240 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.347720 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 18:58:58.422465 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.422433 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.453181 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:58.453140 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0188c9bab58f2eae0db6ef8c05f5cd2f.slice/crio-0fe1ea2b918d980835afee977961528a729aea74b474448095ce60d397b7d3bc WatchSource:0}: Error finding container 0fe1ea2b918d980835afee977961528a729aea74b474448095ce60d397b7d3bc: Status 404 returned error can't find the container with id 0fe1ea2b918d980835afee977961528a729aea74b474448095ce60d397b7d3bc Jun 10 18:58:58.453392 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:58:58.453373 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283531b98bcf29a0a103f2206962df28.slice/crio-69734087907e1be77f72fafa38bfbf51dc8c56e0a87fafe7c75abf03242d6c61 WatchSource:0}: Error finding container 69734087907e1be77f72fafa38bfbf51dc8c56e0a87fafe7c75abf03242d6c61: Status 404 returned error can't find the container with id 69734087907e1be77f72fafa38bfbf51dc8c56e0a87fafe7c75abf03242d6c61 Jun 10 18:58:58.456568 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.456534 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 18:53:57 +0000 UTC" deadline="2028-02-16 19:16:33.67906971 +0000 UTC" Jun 10 18:58:58.456627 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.456573 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14784h17m35.222501504s" Jun 10 18:58:58.458964 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.458949 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 18:58:58.483487 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.483289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" event={"ID":"283531b98bcf29a0a103f2206962df28","Type":"ContainerStarted","Data":"69734087907e1be77f72fafa38bfbf51dc8c56e0a87fafe7c75abf03242d6c61"} Jun 10 18:58:58.486166 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.486127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" event={"ID":"0188c9bab58f2eae0db6ef8c05f5cd2f","Type":"ContainerStarted","Data":"0fe1ea2b918d980835afee977961528a729aea74b474448095ce60d397b7d3bc"} Jun 10 18:58:58.522798 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.522761 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.523872 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.523848 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:58:58.525152 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.525126 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:58:58.525252 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.525168 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:58:58.525252 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.525180 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:58:58.623699 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.623646 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.724216 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.724173 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.799790 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.799701 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:58:58.824663 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.824609 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.925500 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:58.925464 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-152.ec2.internal\" not found" Jun 10 18:58:58.938038 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:58.938005 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:58:59.005667 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.005630 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" Jun 10 18:58:59.022436 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.022406 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 18:58:59.024296 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.024257 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" Jun 10 18:58:59.041424 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.041396 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 18:58:59.233405 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.233318 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:58:59.386889 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.386857 2580 apiserver.go:52] "Watching apiserver" Jun 10 18:58:59.393238 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.393211 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 18:58:59.393699 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.393672 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal","openshift-network-diagnostics/network-check-target-fb4tq","openshift-network-operator/iptables-alerter-9gcwx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q","openshift-cluster-node-tuning-operator/tuned-tlhm4","openshift-dns/node-resolver-4cjkb","openshift-image-registry/node-ca-2pbsn","openshift-multus/multus-additional-cni-plugins-kdltp","openshift-multus/multus-dndm6","openshift-multus/network-metrics-daemon-txpt2","openshift-ovn-kubernetes/ovnkube-node-954vh","kube-system/global-pull-secret-syncer-bwqbf","kube-system/konnectivity-agent-4qhgp"] Jun 10 18:58:59.395163 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.395142 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.396529 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.396507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.396696 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.396662 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:58:59.398318 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.398284 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:58:59.398414 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.398373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:58:59.399568 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.399543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.400833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.400774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.401947 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.401928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.403573 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.403554 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.404942 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.404925 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.405562 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.405542 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 18:58:59.406266 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.406244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.407508 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.407429 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.407508 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.407436 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.407805 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.407790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.408500 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.408455 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.408639 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.408513 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.408639 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.408574 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tkt6l\"" Jun 10 18:58:59.409089 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.408946 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w8cgd\"" Jun 10 18:58:59.409089 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.408957 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.409089 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.409045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cv9dc\"" Jun 10 18:58:59.409409 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.409375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.409816 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.409797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.410229 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410205 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.410386 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410358 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.410512 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410496 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 18:58:59.411274 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410661 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 18:58:59.411274 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410773 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.411274 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.410954 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 18:58:59.411274 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.411003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2tnt5\"" Jun 10 18:58:59.411274 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.411047 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7rn5d\"" Jun 10 18:58:59.412594 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.412555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.412682 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.412616 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 18:58:59.412682 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.412658 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:58:59.413604 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.413149 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 18:58:59.413604 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.413228 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.413604 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.413405 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.413604 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.413546 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.414073 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.414053 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 18:58:59.414162 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.414117 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 18:58:59.414311 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.414290 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 18:58:59.414420 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.414294 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415072 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7jz2g\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415143 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415214 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-87pxv\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415303 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415316 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 18:58:59.415482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415377 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-snhxb\"" Jun 10 18:58:59.415904 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415614 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 18:58:59.415904 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.415620 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 18:58:59.416326 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.416308 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h2pf9\"" Jun 10 18:58:59.418737 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-modprobe-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.418844 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-tmp\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.418844 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-system-cni-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.418844 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-systemd\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-var-lib-kubelet\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-tuned\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-registration-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-conf\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-lib-modules\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419000 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.418994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-host\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-konnectivity-ca\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02db30a6-7a81-4109-90f6-63969727999e-iptables-alerter-script\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419181 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419232 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-sys-fs\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419280 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfxm\" (UniqueName: \"kubernetes.io/projected/4753e3f8-037d-4b1f-923f-97aa04046435-kube-api-access-twfxm\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419312 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419304 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec41b10a-79b5-411f-91d7-358481ed6e84-host\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-sys\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cnibin\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-os-release\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvc7b\" (UniqueName: \"kubernetes.io/projected/02db30a6-7a81-4109-90f6-63969727999e-kube-api-access-pvc7b\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419446 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjdxp\" (UniqueName: \"kubernetes.io/projected/ec41b10a-79b5-411f-91d7-358481ed6e84-kube-api-access-zjdxp\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg5df\" (UniqueName: \"kubernetes.io/projected/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-kube-api-access-pg5df\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec41b10a-79b5-411f-91d7-358481ed6e84-serviceca\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysconfig\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-kubernetes\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-agent-certs\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419664 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfmnm\" (UniqueName: \"kubernetes.io/projected/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-kube-api-access-zfmnm\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02db30a6-7a81-4109-90f6-63969727999e-host-slash\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-socket-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-etc-selinux\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.419833 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5526f749-875e-415e-a78c-0f7085f53dda-hosts-file\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.420496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5526f749-875e-415e-a78c-0f7085f53dda-tmp-dir\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.420496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419814 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hkvg\" (UniqueName: \"kubernetes.io/projected/5526f749-875e-415e-a78c-0f7085f53dda-kube-api-access-2hkvg\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.420496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-run\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.420496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmnz\" (UniqueName: \"kubernetes.io/projected/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-kube-api-access-hmmnz\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.420496 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.419896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-device-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.421026 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.421010 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 18:58:59.426468 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.426439 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 18:58:59.475053 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.475020 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-khgk2" Jun 10 18:58:59.485955 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.485871 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-khgk2" Jun 10 18:58:59.506411 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.506380 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 18:58:59.520875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-daemon-config\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.520875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520881 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-kubelet\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-ovn\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjdxp\" (UniqueName: \"kubernetes.io/projected/ec41b10a-79b5-411f-91d7-358481ed6e84-kube-api-access-zjdxp\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520961 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-socket-dir-parent\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.520982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-etc-kubernetes\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-log-socket\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-config\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521129 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg5df\" (UniqueName: \"kubernetes.io/projected/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-kube-api-access-pg5df\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec41b10a-79b5-411f-91d7-358481ed6e84-serviceca\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68m8f\" (UniqueName: \"kubernetes.io/projected/2762ea4b-5c2e-4890-aa10-f738673d94db-kube-api-access-68m8f\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysconfig\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-kubernetes\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-agent-certs\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfmnm\" (UniqueName: \"kubernetes.io/projected/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-kube-api-access-zfmnm\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-etc-selinux\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521434 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-kubernetes\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-systemd-units\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-dbus\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5526f749-875e-415e-a78c-0f7085f53dda-hosts-file\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5526f749-875e-415e-a78c-0f7085f53dda-tmp-dir\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-run\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-device-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-os-release\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.521705 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ec41b10a-79b5-411f-91d7-358481ed6e84-serviceca\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521718 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-run\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521570 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysconfig\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5526f749-875e-415e-a78c-0f7085f53dda-hosts-file\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-kubelet\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521762 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521775 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-modprobe-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521767 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-device-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-var-lib-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521880 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5526f749-875e-415e-a78c-0f7085f53dda-tmp-dir\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521899 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-etc-selinux\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521882 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-var-lib-kubelet\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-tuned\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521931 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-var-lib-kubelet\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521961 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-modprobe-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.521993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-system-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522019 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cnibin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.522469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppvz\" (UniqueName: \"kubernetes.io/projected/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-kube-api-access-5ppvz\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-sys-fs\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cni-binary-copy\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-node-log\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-env-overrides\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522253 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-sys-fs\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-k8s-cni-cncf-io\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522290 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-conf-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-multus-certs\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-slash\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.522411 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.523251 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.522486 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:00.022463981 +0000 UTC m=+2.977428927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-sys\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cnibin\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522614 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-sys\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522629 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cnibin\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-os-release\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522677 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-d\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvc7b\" (UniqueName: \"kubernetes.io/projected/02db30a6-7a81-4109-90f6-63969727999e-kube-api-access-pvc7b\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-netns\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522771 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-os-release\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-bin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-netns\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-netd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02db30a6-7a81-4109-90f6-63969727999e-host-slash\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-socket-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.524079 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522974 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02db30a6-7a81-4109-90f6-63969727999e-host-slash\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.522989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2762ea4b-5c2e-4890-aa10-f738673d94db-ovn-node-metrics-cert\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-script-lib\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hkvg\" (UniqueName: \"kubernetes.io/projected/5526f749-875e-415e-a78c-0f7085f53dda-kube-api-access-2hkvg\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmnz\" (UniqueName: \"kubernetes.io/projected/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-kube-api-access-hmmnz\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523090 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-socket-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-hostroot\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-etc-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-tmp\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-system-cni-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-kubelet-config\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523370 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-system-cni-dir\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-systemd\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-registration-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.524873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523501 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-systemd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-bin\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523503 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-systemd\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523550 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523562 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4753e3f8-037d-4b1f-923f-97aa04046435-registration-dir\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523593 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-multus\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-conf\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-lib-modules\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-host\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-konnectivity-ca\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02db30a6-7a81-4109-90f6-63969727999e-iptables-alerter-script\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523794 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-sysctl-conf\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfxm\" (UniqueName: \"kubernetes.io/projected/4753e3f8-037d-4b1f-923f-97aa04046435-kube-api-access-twfxm\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.523913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec41b10a-79b5-411f-91d7-358481ed6e84-host\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.525552 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524029 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec41b10a-79b5-411f-91d7-358481ed6e84-host\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524271 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-konnectivity-ca\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524524 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-host\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524554 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02db30a6-7a81-4109-90f6-63969727999e-iptables-alerter-script\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.524911 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-lib-modules\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.525769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-etc-tuned\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.525819 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-tmp\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.526211 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.526085 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/685c0a99-f2fb-4db5-82ff-cd76a5c3e06e-agent-certs\") pod \"konnectivity-agent-4qhgp\" (UID: \"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e\") " pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.534498 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.534466 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg5df\" (UniqueName: \"kubernetes.io/projected/ce43e213-b9c7-4092-83fa-84f7c4e78e7e-kube-api-access-pg5df\") pod \"tuned-tlhm4\" (UID: \"ce43e213-b9c7-4092-83fa-84f7c4e78e7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.534668 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.534638 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfmnm\" (UniqueName: \"kubernetes.io/projected/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-kube-api-access-zfmnm\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:58:59.538487 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.538429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjdxp\" (UniqueName: \"kubernetes.io/projected/ec41b10a-79b5-411f-91d7-358481ed6e84-kube-api-access-zjdxp\") pod \"node-ca-2pbsn\" (UID: \"ec41b10a-79b5-411f-91d7-358481ed6e84\") " pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.538918 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.538537 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:58:59.538918 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.538555 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:58:59.538918 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.538568 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:58:59.538918 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.538719 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:00.038680027 +0000 UTC m=+2.993644962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:58:59.539903 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.539825 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvc7b\" (UniqueName: \"kubernetes.io/projected/02db30a6-7a81-4109-90f6-63969727999e-kube-api-access-pvc7b\") pod \"iptables-alerter-9gcwx\" (UID: \"02db30a6-7a81-4109-90f6-63969727999e\") " pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.541254 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.541221 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmnz\" (UniqueName: \"kubernetes.io/projected/1a99fda3-36e6-4261-b8cf-26fcfa39d4fe-kube-api-access-hmmnz\") pod \"multus-additional-cni-plugins-kdltp\" (UID: \"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe\") " pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.541336 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.541267 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfxm\" (UniqueName: \"kubernetes.io/projected/4753e3f8-037d-4b1f-923f-97aa04046435-kube-api-access-twfxm\") pod \"aws-ebs-csi-driver-node-8w97q\" (UID: \"4753e3f8-037d-4b1f-923f-97aa04046435\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.541651 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.541631 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hkvg\" (UniqueName: \"kubernetes.io/projected/5526f749-875e-415e-a78c-0f7085f53dda-kube-api-access-2hkvg\") pod \"node-resolver-4cjkb\" (UID: \"5526f749-875e-415e-a78c-0f7085f53dda\") " pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.624956 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.624880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.624970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2762ea4b-5c2e-4890-aa10-f738673d94db-ovn-node-metrics-cert\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.624984 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.624997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-script-lib\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-hostroot\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-etc-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-kubelet-config\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-systemd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-hostroot\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-bin\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625140 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-etc-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625184 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625215 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-bin\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-multus\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625249 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-kubelet-config\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-systemd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625295 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-multus\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.625338 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-daemon-config\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:58:59.625392 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:00.125374314 +0000 UTC m=+3.080339248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-kubelet\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-ovn\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-socket-dir-parent\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-etc-kubernetes\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.625517 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-log-socket\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-config\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-script-lib\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625657 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-socket-dir-parent\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-log-socket\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68m8f\" (UniqueName: \"kubernetes.io/projected/2762ea4b-5c2e-4890-aa10-f738673d94db-kube-api-access-68m8f\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-systemd-units\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-ovn-kubernetes\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-etc-kubernetes\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-run-ovn\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-dbus\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-daemon-config\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625910 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-systemd-units\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-os-release\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625966 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-os-release\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ddbca1df-592e-4f20-8348-deea205c37b8-dbus\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:58:59.626168 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625982 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.625992 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-kubelet\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-kubelet\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-var-lib-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626075 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-ovnkube-config\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626084 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-system-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626098 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-kubelet\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cnibin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626137 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-var-lib-openvswitch\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppvz\" (UniqueName: \"kubernetes.io/projected/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-kube-api-access-5ppvz\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cni-binary-copy\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626179 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-system-cni-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cnibin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-node-log\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-env-overrides\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626242 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-node-log\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-k8s-cni-cncf-io\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-conf-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627022 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626399 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-k8s-cni-cncf-io\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626437 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-multus-conf-dir\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-multus-certs\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-slash\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-netns\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-bin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626558 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-slash\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-multus-certs\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-netns\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-netd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-run-netns\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626669 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2762ea4b-5c2e-4890-aa10-f738673d94db-host-cni-netd\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626674 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-var-lib-cni-bin\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626675 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-cni-binary-copy\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626694 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-host-run-netns\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.627879 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.626722 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2762ea4b-5c2e-4890-aa10-f738673d94db-env-overrides\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.628488 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.628338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2762ea4b-5c2e-4890-aa10-f738673d94db-ovn-node-metrics-cert\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.637354 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.637322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68m8f\" (UniqueName: \"kubernetes.io/projected/2762ea4b-5c2e-4890-aa10-f738673d94db-kube-api-access-68m8f\") pod \"ovnkube-node-954vh\" (UID: \"2762ea4b-5c2e-4890-aa10-f738673d94db\") " pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:58:59.637626 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.637603 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppvz\" (UniqueName: \"kubernetes.io/projected/9ff00404-84ff-4be4-afe7-d5bd1bb9896d-kube-api-access-5ppvz\") pod \"multus-dndm6\" (UID: \"9ff00404-84ff-4be4-afe7-d5bd1bb9896d\") " pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.706077 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.706047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4cjkb" Jun 10 18:58:59.717100 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.717068 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9gcwx" Jun 10 18:58:59.725948 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.725908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" Jun 10 18:58:59.730857 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.730820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" Jun 10 18:58:59.737786 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.737725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdltp" Jun 10 18:58:59.743764 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.743741 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:58:59.751361 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.751335 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2pbsn" Jun 10 18:58:59.758050 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.758030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dndm6" Jun 10 18:58:59.762778 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:58:59.762753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:00.029305 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.029220 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:00.029465 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.029335 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:00.029465 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.029393 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:01.029378672 +0000 UTC m=+3.984343589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:00.130553 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.130301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:00.130553 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.130456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.130918 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.131019 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:01.130997689 +0000 UTC m=+4.085962623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.131572 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.131615 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.131647 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:00.132390 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.131701 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:01.13168537 +0000 UTC m=+4.086650302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:00.311651 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.311619 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff00404_84ff_4be4_afe7_d5bd1bb9896d.slice/crio-eefc16541bc2e3d51928eaa249b63ebd0cdb1bb6c09a58179c7faf2fdceefedc WatchSource:0}: Error finding container eefc16541bc2e3d51928eaa249b63ebd0cdb1bb6c09a58179c7faf2fdceefedc: Status 404 returned error can't find the container with id eefc16541bc2e3d51928eaa249b63ebd0cdb1bb6c09a58179c7faf2fdceefedc Jun 10 18:59:00.316568 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.316541 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4753e3f8_037d_4b1f_923f_97aa04046435.slice/crio-ae30d7289a0adb098287d7fa828f839c08a76ce297ce29fe77feeaf1ad1676b3 WatchSource:0}: Error finding container ae30d7289a0adb098287d7fa828f839c08a76ce297ce29fe77feeaf1ad1676b3: Status 404 returned error can't find the container with id ae30d7289a0adb098287d7fa828f839c08a76ce297ce29fe77feeaf1ad1676b3 Jun 10 18:59:00.317191 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.317171 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2762ea4b_5c2e_4890_aa10_f738673d94db.slice/crio-9c70e0f97d692deb0fb34a40bfa6f4167a861b2f2e329617544483a6c3760c3c WatchSource:0}: Error finding container 9c70e0f97d692deb0fb34a40bfa6f4167a861b2f2e329617544483a6c3760c3c: Status 404 returned error can't find the container with id 9c70e0f97d692deb0fb34a40bfa6f4167a861b2f2e329617544483a6c3760c3c Jun 10 18:59:00.318480 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.318458 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5526f749_875e_415e_a78c_0f7085f53dda.slice/crio-575c105d997170e57385e3b8a2889f1d515a016bf0af69554bc7e3f9e250e098 WatchSource:0}: Error finding container 575c105d997170e57385e3b8a2889f1d515a016bf0af69554bc7e3f9e250e098: Status 404 returned error can't find the container with id 575c105d997170e57385e3b8a2889f1d515a016bf0af69554bc7e3f9e250e098 Jun 10 18:59:00.319231 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.319208 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec41b10a_79b5_411f_91d7_358481ed6e84.slice/crio-b90a7b6f77867009c7b1d57c34faaa8aaf9e6d9d69593a54e7e547e1c796a20b WatchSource:0}: Error finding container b90a7b6f77867009c7b1d57c34faaa8aaf9e6d9d69593a54e7e547e1c796a20b: Status 404 returned error can't find the container with id b90a7b6f77867009c7b1d57c34faaa8aaf9e6d9d69593a54e7e547e1c796a20b Jun 10 18:59:00.320166 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.320144 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a99fda3_36e6_4261_b8cf_26fcfa39d4fe.slice/crio-e8e2a327055ed526476a8cf7e9733ab28d7f28e790ccf333153d879375b3ee79 WatchSource:0}: Error finding container e8e2a327055ed526476a8cf7e9733ab28d7f28e790ccf333153d879375b3ee79: Status 404 returned error can't find the container with id e8e2a327055ed526476a8cf7e9733ab28d7f28e790ccf333153d879375b3ee79 Jun 10 18:59:00.322006 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.321980 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685c0a99_f2fb_4db5_82ff_cd76a5c3e06e.slice/crio-3fff2f68fbeec515e9a8ccaaa762300d97fa5b265d3b32b81e57b8a2ec0b4ab1 WatchSource:0}: Error finding container 3fff2f68fbeec515e9a8ccaaa762300d97fa5b265d3b32b81e57b8a2ec0b4ab1: Status 404 returned error can't find the container with id 3fff2f68fbeec515e9a8ccaaa762300d97fa5b265d3b32b81e57b8a2ec0b4ab1 Jun 10 18:59:00.323541 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.323499 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce43e213_b9c7_4092_83fa_84f7c4e78e7e.slice/crio-5004a45de365cd50db6df158f1a81022b19faa9bb1693fe32d61dd71759e1fc8 WatchSource:0}: Error finding container 5004a45de365cd50db6df158f1a81022b19faa9bb1693fe32d61dd71759e1fc8: Status 404 returned error can't find the container with id 5004a45de365cd50db6df158f1a81022b19faa9bb1693fe32d61dd71759e1fc8 Jun 10 18:59:00.324718 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:00.324692 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02db30a6_7a81_4109_90f6_63969727999e.slice/crio-0c3b8aaee903f5a5fb5f56b8071922acb51cb6296c67fb5296d81e1e072dba80 WatchSource:0}: Error finding container 0c3b8aaee903f5a5fb5f56b8071922acb51cb6296c67fb5296d81e1e072dba80: Status 404 returned error can't find the container with id 0c3b8aaee903f5a5fb5f56b8071922acb51cb6296c67fb5296d81e1e072dba80 Jun 10 18:59:00.480114 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.480076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:00.480682 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:00.480220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:00.488133 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.488046 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 18:53:59 +0000 UTC" deadline="2027-11-27 04:54:13.200958703 +0000 UTC" Jun 10 18:59:00.488133 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.488131 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12825h55m12.712832295s" Jun 10 18:59:00.490623 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.490593 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" event={"ID":"4753e3f8-037d-4b1f-923f-97aa04046435","Type":"ContainerStarted","Data":"ae30d7289a0adb098287d7fa828f839c08a76ce297ce29fe77feeaf1ad1676b3"} Jun 10 18:59:00.491735 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.491704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" event={"ID":"ce43e213-b9c7-4092-83fa-84f7c4e78e7e","Type":"ContainerStarted","Data":"5004a45de365cd50db6df158f1a81022b19faa9bb1693fe32d61dd71759e1fc8"} Jun 10 18:59:00.492877 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.492846 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cjkb" event={"ID":"5526f749-875e-415e-a78c-0f7085f53dda","Type":"ContainerStarted","Data":"575c105d997170e57385e3b8a2889f1d515a016bf0af69554bc7e3f9e250e098"} Jun 10 18:59:00.493904 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.493880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerStarted","Data":"e8e2a327055ed526476a8cf7e9733ab28d7f28e790ccf333153d879375b3ee79"} Jun 10 18:59:00.495001 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.494972 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dndm6" event={"ID":"9ff00404-84ff-4be4-afe7-d5bd1bb9896d","Type":"ContainerStarted","Data":"eefc16541bc2e3d51928eaa249b63ebd0cdb1bb6c09a58179c7faf2fdceefedc"} Jun 10 18:59:00.497122 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.497094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" event={"ID":"283531b98bcf29a0a103f2206962df28","Type":"ContainerStarted","Data":"d54afea70b5730e8702c9a8d83bec53987dba6a7bce95e14da8585e6033bde1f"} Jun 10 18:59:00.498153 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.498125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9gcwx" event={"ID":"02db30a6-7a81-4109-90f6-63969727999e","Type":"ContainerStarted","Data":"0c3b8aaee903f5a5fb5f56b8071922acb51cb6296c67fb5296d81e1e072dba80"} Jun 10 18:59:00.499260 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.499227 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4qhgp" event={"ID":"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e","Type":"ContainerStarted","Data":"3fff2f68fbeec515e9a8ccaaa762300d97fa5b265d3b32b81e57b8a2ec0b4ab1"} Jun 10 18:59:00.500377 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.500357 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2pbsn" event={"ID":"ec41b10a-79b5-411f-91d7-358481ed6e84","Type":"ContainerStarted","Data":"b90a7b6f77867009c7b1d57c34faaa8aaf9e6d9d69593a54e7e547e1c796a20b"} Jun 10 18:59:00.501594 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.501556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"9c70e0f97d692deb0fb34a40bfa6f4167a861b2f2e329617544483a6c3760c3c"} Jun 10 18:59:00.514628 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.514561 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-152.ec2.internal" podStartSLOduration=1.5145479769999999 podStartE2EDuration="1.514547977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:00.514451067 +0000 UTC m=+3.469416006" watchObservedRunningTime="2026-06-10 18:59:00.514547977 +0000 UTC m=+3.469512916" Jun 10 18:59:00.757208 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:00.757176 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:01.037498 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.037401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:01.037701 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.037610 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:01.037701 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.037682 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:03.037663965 +0000 UTC m=+5.992628887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:01.138206 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.138119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:01.138206 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.138178 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:01.138451 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138380 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:01.138451 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138400 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:01.138451 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138415 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:01.138773 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138478 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:03.13845831 +0000 UTC m=+6.093423229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:01.138922 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138902 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:01.138977 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.138960 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:03.138945331 +0000 UTC m=+6.093910254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:01.481791 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.481685 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:01.482324 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.481826 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:01.482324 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.482255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:01.482458 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:01.482347 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:01.488766 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.488679 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 18:53:59 +0000 UTC" deadline="2028-02-28 06:52:12.617195818 +0000 UTC" Jun 10 18:59:01.488766 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.488715 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15059h53m11.128485287s" Jun 10 18:59:01.512858 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.512814 2580 generic.go:356] "Generic (PLEG): container finished" podID="0188c9bab58f2eae0db6ef8c05f5cd2f" containerID="1f9bccd8c19f699ef0dec386061ad9c85c1cda36b7f146b01a8e0ed4b003c969" exitCode=0 Jun 10 18:59:01.522689 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:01.522649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" event={"ID":"0188c9bab58f2eae0db6ef8c05f5cd2f","Type":"ContainerDied","Data":"1f9bccd8c19f699ef0dec386061ad9c85c1cda36b7f146b01a8e0ed4b003c969"} Jun 10 18:59:02.479954 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:02.479732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:02.479954 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:02.479904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:02.552185 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:02.552125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" event={"ID":"0188c9bab58f2eae0db6ef8c05f5cd2f","Type":"ContainerStarted","Data":"c95d366f2dccf66f6937be21dbec38205210ac72d1ea13285084409cfb21cb3d"} Jun 10 18:59:03.056695 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:03.056651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:03.056906 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.056874 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:03.056969 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.056945 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:07.056925842 +0000 UTC m=+10.011890774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:03.157751 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:03.157809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.157963 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.157985 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.157997 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.158059 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:07.15803991 +0000 UTC m=+10.113004832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.158473 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:03.158616 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.158534 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:07.158517621 +0000 UTC m=+10.113482552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:03.480416 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:03.480358 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:03.480638 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.480502 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:03.480638 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:03.480375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:03.480638 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:03.480625 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:04.480366 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:04.480161 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:04.480366 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:04.480320 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:05.483940 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:05.483905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:05.484396 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:05.484031 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:05.484396 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:05.484041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:05.484396 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:05.484131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:06.479589 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:06.479292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:06.479589 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:06.479441 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:07.096286 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:07.096238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:07.096774 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.096384 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:07.096774 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.096447 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:15.096431342 +0000 UTC m=+18.051396258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:07.196704 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:07.196644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:07.196923 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:07.196755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:07.196923 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.196875 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:07.197026 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.196944 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:15.196923218 +0000 UTC m=+18.151888137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:07.197143 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.197113 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:07.197226 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.197145 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:07.197226 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.197159 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:07.197226 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.197218 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:15.197201174 +0000 UTC m=+18.152166106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:07.480213 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:07.480180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:07.480482 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.480296 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:07.480482 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:07.480354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:07.480482 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:07.480428 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:08.480229 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:08.480188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:08.480699 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:08.480348 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:09.479962 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:09.479918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:09.480138 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:09.479919 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:09.480138 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:09.480062 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:09.480263 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:09.480136 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:10.479671 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:10.479636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:10.479872 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:10.479781 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:11.479654 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:11.479619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:11.479654 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:11.479654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:11.480202 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:11.479752 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:11.480202 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:11.479883 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:12.479492 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:12.479453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:12.479685 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:12.479608 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:13.480273 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:13.480224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:13.480750 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:13.480242 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:13.480750 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:13.480363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:13.480750 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:13.480469 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:14.480221 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:14.480186 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:14.480630 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:14.480322 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:15.160254 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:15.160201 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:15.160454 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.160351 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:15.160454 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.160445 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:31.160421784 +0000 UTC m=+34.115386705 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:15.260883 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:15.260837 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:15.261075 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:15.260900 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:15.261075 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.260974 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:15.261075 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.261033 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:15.261075 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.261052 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:15.261075 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.261065 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:15.261276 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.261050 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:31.261030949 +0000 UTC m=+34.215995880 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:15.261276 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.261110 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 18:59:31.261099593 +0000 UTC m=+34.216064509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:15.480014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:15.479913 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:15.480014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:15.479954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:15.480242 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.480073 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:15.480242 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:15.480191 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:16.480107 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:16.480072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:16.480618 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:16.480216 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:17.479975 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:17.479938 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:17.480163 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:17.480024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:17.480163 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:17.480107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:17.480538 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:17.480194 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:18.480077 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:18.480033 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:18.480269 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:18.480188 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:19.479942 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.479574 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:19.480132 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.479606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:19.480132 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:19.480053 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:19.480226 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:19.480128 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:19.592729 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.592696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4cjkb" event={"ID":"5526f749-875e-415e-a78c-0f7085f53dda","Type":"ContainerStarted","Data":"64707af718ddd5b7b2cafd430cff56c9ad619c74940e15bf58838768bf5cccd2"} Jun 10 18:59:19.594325 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.594299 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="4c66dda4f25ec942f1b2160d110c1c2832ed5aa93d9b817cef3b1fc22e2500de" exitCode=0 Jun 10 18:59:19.594447 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.594382 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"4c66dda4f25ec942f1b2160d110c1c2832ed5aa93d9b817cef3b1fc22e2500de"} Jun 10 18:59:19.597615 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.597570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dndm6" event={"ID":"9ff00404-84ff-4be4-afe7-d5bd1bb9896d","Type":"ContainerStarted","Data":"028c62cd252a9ffcb4fd88e2a706746df2d07379f20959f99f14abfc0c88c61b"} Jun 10 18:59:19.599120 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.599099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4qhgp" event={"ID":"685c0a99-f2fb-4db5-82ff-cd76a5c3e06e","Type":"ContainerStarted","Data":"353987ae79e42cc7d71de4a3ec6f41974a323a2edd290b1000470422a5edeb2a"} Jun 10 18:59:19.600477 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.600449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2pbsn" event={"ID":"ec41b10a-79b5-411f-91d7-358481ed6e84","Type":"ContainerStarted","Data":"469f50363e949694f2bef4f9ee52056c5654ebb9a7ab8ed783c03d644ea25dc3"} Jun 10 18:59:19.603880 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.603841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"10aea21ec2c10d2a1a0593defb5bac55e6feb98eeec4297f579097d5e1cc2350"} Jun 10 18:59:19.603985 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.603920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"eec9b42148a8f811a0fde57f417125f5a30c06516faef2e7f57ec0339f5e76ec"} Jun 10 18:59:19.603985 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.603969 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"e3633ae511b74f3c844cdc8c8adcce39fd7b7f18b3dfbf2a4c4a5da948a5b380"} Jun 10 18:59:19.604059 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.604004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"ff659f75d7821ed220729f204689224156926dbcc645cc18256232a6dd1d5161"} Jun 10 18:59:19.604059 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.604035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"1aba2a7c051b059e2e65841abcabb69bb548812159d2b9c7f92fd79b943959d2"} Jun 10 18:59:19.605358 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.605333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" event={"ID":"4753e3f8-037d-4b1f-923f-97aa04046435","Type":"ContainerStarted","Data":"89ff5e6ba47d35a9a9aa906222e015916984a567093e3d70faaa3dc9b71fdc1e"} Jun 10 18:59:19.606867 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.606832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" event={"ID":"ce43e213-b9c7-4092-83fa-84f7c4e78e7e","Type":"ContainerStarted","Data":"0724e6dc298d1e8a2b6b36d5ae20924c467a07cfc6a9bff9325fe245ed63ecb2"} Jun 10 18:59:19.623014 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.622952 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-152.ec2.internal" podStartSLOduration=20.622938459 podStartE2EDuration="20.622938459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:02.599234641 +0000 UTC m=+5.554199580" watchObservedRunningTime="2026-06-10 18:59:19.622938459 +0000 UTC m=+22.577903397" Jun 10 18:59:19.667380 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.667326 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4cjkb" podStartSLOduration=3.902278672 podStartE2EDuration="22.667306724s" totalImagesPullingTime="18.765028052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:19.622861902 +0000 UTC m=+22.577826841" watchObservedRunningTime="2026-06-10 18:59:19.667306724 +0000 UTC m=+22.622271662" Jun 10 18:59:19.708792 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.708742 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tlhm4" podStartSLOduration=3.9457768939999998 podStartE2EDuration="22.708724997s" totalImagesPullingTime="18.762948103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:19.667489833 +0000 UTC m=+22.622454772" watchObservedRunningTime="2026-06-10 18:59:19.708724997 +0000 UTC m=+22.663689936" Jun 10 18:59:19.771427 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.771374 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dndm6" podStartSLOduration=3.983465958 podStartE2EDuration="22.771352089s" totalImagesPullingTime="18.787886131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:19.709011867 +0000 UTC m=+22.663976806" watchObservedRunningTime="2026-06-10 18:59:19.771352089 +0000 UTC m=+22.726317088" Jun 10 18:59:19.812406 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:19.812354 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4qhgp" podStartSLOduration=4.050294008 podStartE2EDuration="22.812334186s" totalImagesPullingTime="18.762040178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:19.811896273 +0000 UTC m=+22.766861213" watchObservedRunningTime="2026-06-10 18:59:19.812334186 +0000 UTC m=+22.767299124" Jun 10 18:59:20.202245 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.202205 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 18:59:20.479976 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.479867 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T18:59:20.202238705Z","UUID":"3068eb77-9140-4f5c-924d-970a8e8f0353","Handler":null,"Name":"","Endpoint":""} Jun 10 18:59:20.479976 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.479963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:20.480224 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:20.480087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:20.481673 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.481638 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 18:59:20.481802 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.481684 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 18:59:20.613603 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.613547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"699da9533837b70d5f7c2ba72dcebd714c25592d4df7264946db96f7f07e5594"} Jun 10 18:59:20.616001 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:20.615967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" event={"ID":"4753e3f8-037d-4b1f-923f-97aa04046435","Type":"ContainerStarted","Data":"c3c24ec685eab32b85a8303d6bd2a98ea47c5a837913f89048c64a11cf053465"} Jun 10 18:59:21.479550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.479504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:21.479550 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.479552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:21.479796 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:21.479672 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:21.479883 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:21.479796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:21.620597 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.620518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" event={"ID":"4753e3f8-037d-4b1f-923f-97aa04046435","Type":"ContainerStarted","Data":"85be58c2d3f496c77397794f6169f9f9414da53545fee1cb29a45cc0a40a42b1"} Jun 10 18:59:21.622547 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.622515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9gcwx" event={"ID":"02db30a6-7a81-4109-90f6-63969727999e","Type":"ContainerStarted","Data":"91d0c8e2c88f4fbb5dcdd3191d2fc073319e79618ffe4376b68e13ab87a137bb"} Jun 10 18:59:21.647505 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.647308 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8w97q" podStartSLOduration=4.358721629 podStartE2EDuration="24.647287459s" totalImagesPullingTime="20.28856583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:21.647182599 +0000 UTC m=+24.602147539" watchObservedRunningTime="2026-06-10 18:59:21.647287459 +0000 UTC m=+24.602252394" Jun 10 18:59:21.647721 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.647688 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2pbsn" podStartSLOduration=5.883403581 podStartE2EDuration="24.647674615s" totalImagesPullingTime="18.764271034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:19.880743659 +0000 UTC m=+22.835708599" watchObservedRunningTime="2026-06-10 18:59:21.647674615 +0000 UTC m=+24.602639556" Jun 10 18:59:21.666556 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:21.666493 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9gcwx" podStartSLOduration=5.907395905 podStartE2EDuration="24.666467916s" totalImagesPullingTime="18.759072011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:21.665621954 +0000 UTC m=+24.620586894" watchObservedRunningTime="2026-06-10 18:59:21.666467916 +0000 UTC m=+24.621432860" Jun 10 18:59:22.480318 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:22.480094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:22.480531 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:22.480434 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:22.629152 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:22.629100 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"9c15d50f046b407e185a5df89c6c8250adc6ec419ed2c71c8444538eb310c0a9"} Jun 10 18:59:23.480284 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:23.480238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:23.480480 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:23.480257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:23.480480 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:23.480391 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:23.480480 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:23.480470 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:23.748749 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:23.748668 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:59:23.749335 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:23.749317 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:59:24.480030 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.479813 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:24.480208 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:24.480133 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:24.637598 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.637544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" event={"ID":"2762ea4b-5c2e-4890-aa10-f738673d94db","Type":"ContainerStarted","Data":"51a35c8ea92e2771c6a00d0f2b94d98b66e7e8cbcc68da7e8be64c1198645c43"} Jun 10 18:59:24.637822 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.637796 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:24.639405 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.639374 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="d058098fa5fe746d540e840d0d6143fc06fb9c1c24f4284315e570c434071849" exitCode=0 Jun 10 18:59:24.639515 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.639416 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"d058098fa5fe746d540e840d0d6143fc06fb9c1c24f4284315e570c434071849"} Jun 10 18:59:24.639631 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.639615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:59:24.640264 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.640244 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4qhgp" Jun 10 18:59:24.654858 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.654831 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:24.684602 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:24.684531 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" podStartSLOduration=8.86373839 podStartE2EDuration="27.684515108s" totalImagesPullingTime="18.820776718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.682987711 +0000 UTC m=+27.637952649" watchObservedRunningTime="2026-06-10 18:59:24.684515108 +0000 UTC m=+27.639480047" Jun 10 18:59:25.479703 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:25.479667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:25.480452 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:25.479667 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:25.480452 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:25.479782 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:25.480452 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:25.479855 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:25.644766 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:25.643715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:25.644766 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:25.643815 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:25.660265 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:25.660234 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:26.235380 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.235343 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fb4tq"] Jun 10 18:59:26.235653 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.235460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:26.235653 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:26.235570 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:26.238529 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.238502 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwqbf"] Jun 10 18:59:26.238645 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.238627 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:26.238722 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:26.238705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:26.243163 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.243139 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txpt2"] Jun 10 18:59:26.243259 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.243244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:26.243343 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:26.243325 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:26.645672 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.645563 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="965dfa15ee6e1f75a385627cb6652dd6f1c63dcf69b962253ebeb68360f28711" exitCode=0 Jun 10 18:59:26.645672 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:26.645619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"965dfa15ee6e1f75a385627cb6652dd6f1c63dcf69b962253ebeb68360f28711"} Jun 10 18:59:27.480730 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:27.480703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:27.480932 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:27.480783 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:27.480932 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:27.480866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:27.481062 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:27.480987 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:28.480469 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:28.480274 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:28.480843 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:28.480564 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:28.652652 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:28.652546 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="569f65d3ab6ee5c6b2e3878b913a537a8c3dc5703f5e6ab82d65c4f4c3213169" exitCode=0 Jun 10 18:59:28.652652 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:28.652614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"569f65d3ab6ee5c6b2e3878b913a537a8c3dc5703f5e6ab82d65c4f4c3213169"} Jun 10 18:59:29.479747 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:29.479710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:29.479955 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:29.479710 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:29.479955 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:29.479841 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:29.479955 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:29.479921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:30.480099 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:30.480064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:30.480637 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:30.480200 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 18:59:31.174721 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.174686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:31.174905 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.174837 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:31.174955 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.174906 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:03.174886264 +0000 UTC m=+66.129851191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:31.275985 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.275946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:31.275985 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.275985 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276104 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276112 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276130 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276142 2580 projected.go:196] Error preparing data for projected volume kube-api-access-mws64 for pod openshift-network-diagnostics/network-check-target-fb4tq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276177 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret podName:ddbca1df-592e-4f20-8348-deea205c37b8 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:03.276157602 +0000 UTC m=+66.231122527 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret") pod "global-pull-secret-syncer-bwqbf" (UID: "ddbca1df-592e-4f20-8348-deea205c37b8") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:31.276223 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.276194 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64 podName:08b990ef-1c26-48f7-a305-cc43aef3154d nodeName:}" failed. No retries permitted until 2026-06-10 19:00:03.276187566 +0000 UTC m=+66.231152487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mws64" (UniqueName: "kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64") pod "network-check-target-fb4tq" (UID: "08b990ef-1c26-48f7-a305-cc43aef3154d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:31.479766 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.479671 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:31.479953 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.479680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:31.479953 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.479820 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bwqbf" podUID="ddbca1df-592e-4f20-8348-deea205c37b8" Jun 10 18:59:31.479953 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:31.479888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fb4tq" podUID="08b990ef-1c26-48f7-a305-cc43aef3154d" Jun 10 18:59:31.913057 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.913026 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-152.ec2.internal" event="NodeReady" Jun 10 18:59:31.913241 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.913185 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 18:59:31.966873 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.966839 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 18:59:31.995394 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:31.995356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.008740 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.008711 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 18:59:32.008916 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.008710 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 18:59:32.021701 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.021671 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfhcn\"" Jun 10 18:59:32.033666 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.033635 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 18:59:32.034525 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.034503 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 18:59:32.047147 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.047112 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n6sst"] Jun 10 18:59:32.048019 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.047990 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 18:59:32.075123 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.075081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.078348 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.078322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77lp9\"" Jun 10 18:59:32.078479 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.078322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 18:59:32.078716 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.078697 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 18:59:32.081117 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.081022 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k67sp"] Jun 10 18:59:32.083708 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.083708 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.083875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.083875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.083875 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083855 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.084035 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.084035 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.084035 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.083968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46hrv\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.103271 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.103237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.106493 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.106450 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 18:59:32.106676 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.106546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htph4\"" Jun 10 18:59:32.106918 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.106897 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 18:59:32.107097 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.107069 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 18:59:32.114886 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.114864 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k67sp"] Jun 10 18:59:32.120066 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.120026 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n6sst"] Jun 10 18:59:32.185096 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.184976 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f56c490-be16-47ce-9ccf-3795d9b2b34a-tmp-dir\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.185096 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185096 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvn5\" (UniqueName: \"kubernetes.io/projected/5f56c490-be16-47ce-9ccf-3795d9b2b34a-kube-api-access-rrvn5\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-cert\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c490-be16-47ce-9ccf-3795d9b2b34a-config-volume\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht5pp\" (UniqueName: \"kubernetes.io/projected/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-kube-api-access-ht5pp\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46hrv\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.185338 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.186219 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.185856 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:32.186219 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.185877 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:32.186219 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.185976 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:32.685921846 +0000 UTC m=+35.640886782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:32.186219 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.185998 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.186433 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.186241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.186846 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.186798 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.190985 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.190962 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.191103 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.191010 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.196562 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.196533 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46hrv\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.202353 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.202323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.286067 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286028 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c490-be16-47ce-9ccf-3795d9b2b34a-config-volume\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.286067 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht5pp\" (UniqueName: \"kubernetes.io/projected/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-kube-api-access-ht5pp\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.286344 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.286344 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f56c490-be16-47ce-9ccf-3795d9b2b34a-tmp-dir\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.286344 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvn5\" (UniqueName: \"kubernetes.io/projected/5f56c490-be16-47ce-9ccf-3795d9b2b34a-kube-api-access-rrvn5\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.286344 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-cert\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.286344 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.286275 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:32.286614 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.286351 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:32.786327465 +0000 UTC m=+35.741292402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:32.286727 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f56c490-be16-47ce-9ccf-3795d9b2b34a-tmp-dir\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.286794 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.286769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c490-be16-47ce-9ccf-3795d9b2b34a-config-volume\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.288951 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.288929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-cert\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.301466 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.301439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht5pp\" (UniqueName: \"kubernetes.io/projected/8c5a2208-7ba4-4876-8d7b-b4f3f4917d95-kube-api-access-ht5pp\") pod \"ingress-canary-k67sp\" (UID: \"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95\") " pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.307037 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.307008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvn5\" (UniqueName: \"kubernetes.io/projected/5f56c490-be16-47ce-9ccf-3795d9b2b34a-kube-api-access-rrvn5\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.414576 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.414545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k67sp" Jun 10 18:59:32.479740 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.479699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 18:59:32.483659 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.483568 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 18:59:32.484295 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.483743 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j57pv\"" Jun 10 18:59:32.689070 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.688992 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:32.689181 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.689154 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:32.689181 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.689180 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:32.689369 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.689248 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:33.68922531 +0000 UTC m=+36.644190230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:32.745575 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.745336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k67sp"] Jun 10 18:59:32.789732 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:32.789699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:32.789891 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.789810 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:32.789891 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:32.789866 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:33.789849379 +0000 UTC m=+36.744814296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:32.829279 ip-10-0-143-152 kubenswrapper[2580]: W0610 18:59:32.829243 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5a2208_7ba4_4876_8d7b_b4f3f4917d95.slice/crio-bbbdd8ed73d43fe7413c5a4bad7cfe2230d011fd396a9b886f17637890b95574 WatchSource:0}: Error finding container bbbdd8ed73d43fe7413c5a4bad7cfe2230d011fd396a9b886f17637890b95574: Status 404 returned error can't find the container with id bbbdd8ed73d43fe7413c5a4bad7cfe2230d011fd396a9b886f17637890b95574 Jun 10 18:59:33.483320 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.483288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 18:59:33.483472 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.483450 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 18:59:33.486569 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.486544 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 18:59:33.487011 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.486755 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 18:59:33.487837 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.487815 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2b6f\"" Jun 10 18:59:33.487837 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.487831 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 18:59:33.669393 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.669357 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="40b59aadaa0add0717e421df8140b0e5af7e519bc5faeb961118d60e8de089bf" exitCode=0 Jun 10 18:59:33.669572 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.669478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"40b59aadaa0add0717e421df8140b0e5af7e519bc5faeb961118d60e8de089bf"} Jun 10 18:59:33.670961 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.670933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k67sp" event={"ID":"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95","Type":"ContainerStarted","Data":"bbbdd8ed73d43fe7413c5a4bad7cfe2230d011fd396a9b886f17637890b95574"} Jun 10 18:59:33.695252 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.695215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:33.695376 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:33.695349 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:33.695376 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:33.695365 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:33.695492 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:33.695426 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:35.695405213 +0000 UTC m=+38.650370144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:33.796105 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:33.796061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:33.796284 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:33.796207 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:33.796284 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:33.796276 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:35.796257274 +0000 UTC m=+38.751222197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:34.675802 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:34.675766 2580 generic.go:356] "Generic (PLEG): container finished" podID="1a99fda3-36e6-4261-b8cf-26fcfa39d4fe" containerID="1efdbb7a95ef8dbcc03fc7629fe53ce6283c7d6fb12a8e72f7252137e9449b59" exitCode=0 Jun 10 18:59:34.676383 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:34.675818 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerDied","Data":"1efdbb7a95ef8dbcc03fc7629fe53ce6283c7d6fb12a8e72f7252137e9449b59"} Jun 10 18:59:35.679328 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.679288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k67sp" event={"ID":"8c5a2208-7ba4-4876-8d7b-b4f3f4917d95","Type":"ContainerStarted","Data":"c546ac7a3bcb6f686f036a81bbd1fd3589431157e13bcf5c2f6ebcea6af803a5"} Jun 10 18:59:35.682696 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.682664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdltp" event={"ID":"1a99fda3-36e6-4261-b8cf-26fcfa39d4fe","Type":"ContainerStarted","Data":"7952d4a7d67467c6d1970142cf84d5d4237a0831fbe12c129be5ef1e42992852"} Jun 10 18:59:35.696411 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.696359 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k67sp" podStartSLOduration=2.201910621 podStartE2EDuration="4.69634334s" totalImagesPullingTime="2.494432719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:35.696147907 +0000 UTC m=+38.651112845" watchObservedRunningTime="2026-06-10 18:59:35.69634334 +0000 UTC m=+38.651308257" Jun 10 18:59:35.710918 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.710888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:35.711094 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:35.711073 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:35.711149 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:35.711099 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:35.711184 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:35.711171 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:39.711149058 +0000 UTC m=+42.666113981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:35.719806 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.719738 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kdltp" podStartSLOduration=9.199113812 podStartE2EDuration="38.7197029s" totalImagesPullingTime="29.520589088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:35.718839012 +0000 UTC m=+38.673803961" watchObservedRunningTime="2026-06-10 18:59:35.7197029 +0000 UTC m=+38.674667833" Jun 10 18:59:35.811854 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.811812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:35.812035 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:35.811963 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:35.812105 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:35.812039 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:39.8120186 +0000 UTC m=+42.766983517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:35.863881 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.863836 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:35.963626 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:35.963512 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:36.477503 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:36.477464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:36.561403 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:36.561362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:39.742272 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:39.742227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:39.742792 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:39.742407 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:39.742792 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:39.742429 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:39.742792 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:39.742491 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:47.742474699 +0000 UTC m=+50.697439616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:39.843347 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:39.843307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:39.843526 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:39.843468 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:39.843562 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:39.843537 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:47.843518972 +0000 UTC m=+50.798483889 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:40.746719 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:40.746683 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:40.861254 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:40.861220 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:41.433013 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:41.432978 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:41.500973 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:41.500942 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:41.912431 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:41.912402 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:41.973596 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:41.973557 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:42.039219 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:42.039177 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:43.340787 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:43.340752 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:43.440532 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:43.440499 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:45.618114 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:45.618083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:45.718540 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:45.718509 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:47.805137 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:47.805087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 18:59:47.805665 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:47.805253 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 18:59:47.805665 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:47.805273 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 18:59:47.805665 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:47.805345 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:03.805326454 +0000 UTC m=+66.760291374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 18:59:47.906244 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:47.906199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 18:59:47.906442 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:47.906368 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:47.906442 ip-10-0-143-152 kubenswrapper[2580]: E0610 18:59:47.906441 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 19:00:03.906425152 +0000 UTC m=+66.861390068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 18:59:57.667272 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:57.667239 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-954vh" Jun 10 18:59:57.825096 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:57.825059 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:57.924630 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:57.924542 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 18:59:58.014946 ip-10-0-143-152 kubenswrapper[2580]: I0610 18:59:58.014912 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:01.717509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:01.717479 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:01.786722 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:01.786682 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:03.221970 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.221936 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:00:03.225063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.225045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 19:00:03.232559 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.232537 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 19:00:03.232669 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.232641 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 19:01:07.232620907 +0000 UTC m=+130.187585828 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : secret "metrics-daemon-secret" not found Jun 10 19:00:03.323050 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.323000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 19:00:03.323050 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.323056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 19:00:03.326095 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.326063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 19:00:03.326222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.326142 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 19:00:03.336247 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.336225 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 19:00:03.337394 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.337373 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ddbca1df-592e-4f20-8348-deea205c37b8-original-pull-secret\") pod \"global-pull-secret-syncer-bwqbf\" (UID: \"ddbca1df-592e-4f20-8348-deea205c37b8\") " pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 19:00:03.345988 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.345962 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mws64\" (UniqueName: \"kubernetes.io/projected/08b990ef-1c26-48f7-a305-cc43aef3154d-kube-api-access-mws64\") pod \"network-check-target-fb4tq\" (UID: \"08b990ef-1c26-48f7-a305-cc43aef3154d\") " pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 19:00:03.493652 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.493547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bwqbf" Jun 10 19:00:03.501715 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.501691 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2b6f\"" Jun 10 19:00:03.509552 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.509522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 19:00:03.629708 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.629673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bwqbf"] Jun 10 19:00:03.633772 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:00:03.633745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddbca1df_592e_4f20_8348_deea205c37b8.slice/crio-c8ffa300c128b9a25ff0cfd55bd7f7075c7b6651bc724abf6dfdfa1fcc22830a WatchSource:0}: Error finding container c8ffa300c128b9a25ff0cfd55bd7f7075c7b6651bc724abf6dfdfa1fcc22830a: Status 404 returned error can't find the container with id c8ffa300c128b9a25ff0cfd55bd7f7075c7b6651bc724abf6dfdfa1fcc22830a Jun 10 19:00:03.650079 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.650027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fb4tq"] Jun 10 19:00:03.652746 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:00:03.652715 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b990ef_1c26_48f7_a305_cc43aef3154d.slice/crio-d984e02cbea6f3248409abf4bccbd11ab95283f71640fc53b9714efbb5af4751 WatchSource:0}: Error finding container d984e02cbea6f3248409abf4bccbd11ab95283f71640fc53b9714efbb5af4751: Status 404 returned error can't find the container with id d984e02cbea6f3248409abf4bccbd11ab95283f71640fc53b9714efbb5af4751 Jun 10 19:00:03.748986 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.748901 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwqbf" event={"ID":"ddbca1df-592e-4f20-8348-deea205c37b8","Type":"ContainerStarted","Data":"c8ffa300c128b9a25ff0cfd55bd7f7075c7b6651bc724abf6dfdfa1fcc22830a"} Jun 10 19:00:03.749982 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.749959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fb4tq" event={"ID":"08b990ef-1c26-48f7-a305-cc43aef3154d","Type":"ContainerStarted","Data":"d984e02cbea6f3248409abf4bccbd11ab95283f71640fc53b9714efbb5af4751"} Jun 10 19:00:03.826327 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.826294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:00:03.826504 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.826454 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:00:03.826504 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.826475 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 19:00:03.826572 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.826536 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:35.826517812 +0000 UTC m=+98.781482732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 19:00:03.927595 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:03.927530 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 19:00:03.927776 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.927689 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:00:03.927776 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:03.927754 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 19:00:35.927738225 +0000 UTC m=+98.882703142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 19:00:05.895247 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:05.895211 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:05.959281 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:05.959189 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:06.760311 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:06.760215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fb4tq" event={"ID":"08b990ef-1c26-48f7-a305-cc43aef3154d","Type":"ContainerStarted","Data":"1eb53f67a98371ec3888cac44d0e82195745fbc649f038cf75afbdab24f76ee4"} Jun 10 19:00:06.760467 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:06.760343 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 19:00:06.778693 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:06.778645 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fb4tq" podStartSLOduration=66.925604736 podStartE2EDuration="1m9.778629653s" totalImagesPullingTime="2.853024917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:00:06.777111328 +0000 UTC m=+69.732076411" watchObservedRunningTime="2026-06-10 19:00:06.778629653 +0000 UTC m=+69.733594569" Jun 10 19:00:08.767612 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:08.767556 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bwqbf" event={"ID":"ddbca1df-592e-4f20-8348-deea205c37b8","Type":"ContainerStarted","Data":"58d61085c57dc8fe5f762cdd08dca430f6ed8e029b87f91bf0fa42be11bc0c68"} Jun 10 19:00:08.783999 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:08.783946 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bwqbf" podStartSLOduration=66.087574584 podStartE2EDuration="1m10.783929349s" totalImagesPullingTime="4.696354765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:58:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:00:08.783144336 +0000 UTC m=+71.738109274" watchObservedRunningTime="2026-06-10 19:00:08.783929349 +0000 UTC m=+71.738894287" Jun 10 19:00:12.318190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:12.318154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:12.384628 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:12.384596 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:29.818853 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:29.818702 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:00:35.870096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:35.870041 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:00:35.870495 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:35.870202 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:00:35.870495 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:35.870225 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 19:00:35.870495 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:35.870283 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 19:01:39.870268796 +0000 UTC m=+162.825233713 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 19:00:35.971157 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:35.971125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 19:00:35.971318 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:35.971303 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:00:35.971402 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:00:35.971388 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 19:01:39.971365339 +0000 UTC m=+162.926330282 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 19:00:37.766723 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:00:37.766690 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fb4tq" Jun 10 19:01:07.297383 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:07.297335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:01:07.297896 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:07.297485 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 19:01:07.297896 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:07.297561 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs podName:3b87dee1-c5f2-4366-8e5c-42f50251a8a4 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:09.297542164 +0000 UTC m=+252.252507083 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs") pod "network-metrics-daemon-txpt2" (UID: "3b87dee1-c5f2-4366-8e5c-42f50251a8a4") : secret "metrics-daemon-secret" not found Jun 10 19:01:35.008743 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:35.008690 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" Jun 10 19:01:35.085926 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:35.085871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n6sst" podUID="5f56c490-be16-47ce-9ccf-3795d9b2b34a" Jun 10 19:01:35.494157 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:35.494116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-txpt2" podUID="3b87dee1-c5f2-4366-8e5c-42f50251a8a4" Jun 10 19:01:35.973010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:35.972980 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n6sst" Jun 10 19:01:35.973171 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:35.972981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:01:39.929976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:39.929919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:01:39.930482 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:39.930066 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:01:39.930482 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:39.930086 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59f7b7d997-zx2vj: secret "image-registry-tls" not found Jun 10 19:01:39.930482 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:39.930146 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls podName:c22651b6-5bc6-41cb-8810-9d18eff99d93 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:41.930130197 +0000 UTC m=+284.885095113 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls") pod "image-registry-59f7b7d997-zx2vj" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93") : secret "image-registry-tls" not found Jun 10 19:01:40.031016 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:40.030950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 19:01:40.031219 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:40.031114 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:01:40.031219 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:01:40.031202 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls podName:5f56c490-be16-47ce-9ccf-3795d9b2b34a nodeName:}" failed. No retries permitted until 2026-06-10 19:03:42.031186315 +0000 UTC m=+284.986151233 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls") pod "dns-default-n6sst" (UID: "5f56c490-be16-47ce-9ccf-3795d9b2b34a") : secret "dns-default-metrics-tls" not found Jun 10 19:01:50.479820 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:50.479720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:01:53.573296 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:01:53.573257 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:23.679176 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:23.679143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:23.801239 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:23.801213 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:26.439746 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.439709 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc"] Jun 10 19:02:26.441697 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.441680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" Jun 10 19:02:26.446815 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.446782 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:02:26.446947 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.446782 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 19:02:26.448854 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.448834 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-srg95\"" Jun 10 19:02:26.456263 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.456154 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm"] Jun 10 19:02:26.458517 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.458493 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm"] Jun 10 19:02:26.459521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.459496 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.461173 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.461153 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj"] Jun 10 19:02:26.461970 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.461842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.463542 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.463522 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 19:02:26.463651 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.463557 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:02:26.463651 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.463522 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 19:02:26.463745 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.463659 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mw62j\"" Jun 10 19:02:26.463821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.463807 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 19:02:26.464087 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.464068 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c4f6d6d85-79t56"] Jun 10 19:02:26.464168 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.464139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.465878 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.465859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.467402 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.467372 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc"] Jun 10 19:02:26.468902 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.468879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 19:02:26.469801 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469783 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 19:02:26.469989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469970 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 19:02:26.470100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469821 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 19:02:26.470100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ls6hw\"" Jun 10 19:02:26.470100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469942 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cnqvq\"" Jun 10 19:02:26.470100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.469786 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 19:02:26.470383 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.470366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-67c99\"" Jun 10 19:02:26.470460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.470365 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 19:02:26.470669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.470653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 19:02:26.470851 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.470804 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 19:02:26.471152 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.471133 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 19:02:26.471464 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.471434 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:02:26.471681 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.471660 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 19:02:26.472691 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.472677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 19:02:26.475071 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.475039 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm"] Jun 10 19:02:26.481355 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.481333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm"] Jun 10 19:02:26.488951 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.488923 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj"] Jun 10 19:02:26.502090 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.502055 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c4f6d6d85-79t56"] Jun 10 19:02:26.568806 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gct4\" (UniqueName: \"kubernetes.io/projected/a405376a-7488-472b-8452-e6598690754d-kube-api-access-7gct4\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7c8t\" (UniqueName: \"kubernetes.io/projected/e71512aa-7d10-49de-bedb-0e8231a5329d-kube-api-access-x7c8t\") pod \"volume-data-source-validator-78dd696465-hlvbc\" (UID: \"e71512aa-7d10-49de-bedb-0e8231a5329d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.568992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.568975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-default-certificate\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvcqr\" (UniqueName: \"kubernetes.io/projected/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-kube-api-access-zvcqr\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-config\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-stats-auth\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.569210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.569200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpc8x\" (UniqueName: \"kubernetes.io/projected/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-kube-api-access-bpc8x\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.582404 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.582374 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-sfv6h"] Jun 10 19:02:26.585188 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.585168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.588159 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.588138 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 19:02:26.588256 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.588138 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 19:02:26.588641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.588610 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zms6w\"" Jun 10 19:02:26.588755 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.588743 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 19:02:26.589215 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.589197 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 19:02:26.613821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.613794 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 19:02:26.632871 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.632831 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-sfv6h"] Jun 10 19:02:26.660653 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.660621 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9"] Jun 10 19:02:26.662790 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.662694 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" Jun 10 19:02:26.667329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.667311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c86cm\"" Jun 10 19:02:26.669500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpc8x\" (UniqueName: \"kubernetes.io/projected/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-kube-api-access-bpc8x\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.669634 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e49142da-6ba2-429f-8d93-bcee57e9b251-serving-cert\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.669634 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.669735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gct4\" (UniqueName: \"kubernetes.io/projected/a405376a-7488-472b-8452-e6598690754d-kube-api-access-7gct4\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.669735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669691 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-snapshots\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.669735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-service-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.669908 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.669908 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7c8t\" (UniqueName: \"kubernetes.io/projected/e71512aa-7d10-49de-bedb-0e8231a5329d-kube-api-access-x7c8t\") pod \"volume-data-source-validator-78dd696465-hlvbc\" (UID: \"e71512aa-7d10-49de-bedb-0e8231a5329d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" Jun 10 19:02:26.669908 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-trusted-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.670059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.670059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.670059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.669979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.670059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-default-certificate\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.670059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:26.670063 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:26.670082 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:27.170062108 +0000 UTC m=+210.125027042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:26.670114 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:27.170102003 +0000 UTC m=+210.125066920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-tmp\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670149 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvcqr\" (UniqueName: \"kubernetes.io/projected/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-kube-api-access-zvcqr\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h44wr\" (UniqueName: \"kubernetes.io/projected/e49142da-6ba2-429f-8d93-bcee57e9b251-kube-api-access-h44wr\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.670305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-config\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.670733 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-stats-auth\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.670733 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670374 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.670838 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:26.670894 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.670840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-config\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.670948 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:26.670930 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:26.670993 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:26.670977 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:27.170961672 +0000 UTC m=+210.125926590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:26.672276 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.672252 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.672727 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.672708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.672727 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.672718 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-default-certificate\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.672860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.672840 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-stats-auth\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.684914 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.684886 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9"] Jun 10 19:02:26.695912 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.695846 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpc8x\" (UniqueName: \"kubernetes.io/projected/62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0-kube-api-access-bpc8x\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-lktvm\" (UID: \"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.696034 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.695997 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gct4\" (UniqueName: \"kubernetes.io/projected/a405376a-7488-472b-8452-e6598690754d-kube-api-access-7gct4\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:26.699773 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.699745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7c8t\" (UniqueName: \"kubernetes.io/projected/e71512aa-7d10-49de-bedb-0e8231a5329d-kube-api-access-x7c8t\") pod \"volume-data-source-validator-78dd696465-hlvbc\" (UID: \"e71512aa-7d10-49de-bedb-0e8231a5329d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" Jun 10 19:02:26.700405 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.700380 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvcqr\" (UniqueName: \"kubernetes.io/projected/50ad6772-c21e-48fd-b7b7-0f36fda7fd46-kube-api-access-zvcqr\") pod \"service-ca-operator-6bc5ff68f5-wkjjj\" (UID: \"50ad6772-c21e-48fd-b7b7-0f36fda7fd46\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.750228 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.750187 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" Jun 10 19:02:26.771442 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-snapshots\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.771595 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-service-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.771595 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwnz9\" (UniqueName: \"kubernetes.io/projected/75b5ff7d-66bc-463e-ae67-b412a1f5a727-kube-api-access-kwnz9\") pod \"network-check-source-dbd9cf844-qwxb9\" (UID: \"75b5ff7d-66bc-463e-ae67-b412a1f5a727\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" Jun 10 19:02:26.771595 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-trusted-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.771775 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771752 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-tmp\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.771825 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h44wr\" (UniqueName: \"kubernetes.io/projected/e49142da-6ba2-429f-8d93-bcee57e9b251-kube-api-access-h44wr\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.771944 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.771923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e49142da-6ba2-429f-8d93-bcee57e9b251-serving-cert\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.772213 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.772186 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-service-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.772344 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.772322 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-snapshots\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.772600 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.772565 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e49142da-6ba2-429f-8d93-bcee57e9b251-tmp\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.772956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.772939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e49142da-6ba2-429f-8d93-bcee57e9b251-trusted-ca-bundle\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.773502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.773492 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" Jun 10 19:02:26.774327 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.774307 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e49142da-6ba2-429f-8d93-bcee57e9b251-serving-cert\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.781114 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.781087 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h44wr\" (UniqueName: \"kubernetes.io/projected/e49142da-6ba2-429f-8d93-bcee57e9b251-kube-api-access-h44wr\") pod \"insights-operator-896549976-sfv6h\" (UID: \"e49142da-6ba2-429f-8d93-bcee57e9b251\") " pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.787740 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.787715 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" Jun 10 19:02:26.873310 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.873272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwnz9\" (UniqueName: \"kubernetes.io/projected/75b5ff7d-66bc-463e-ae67-b412a1f5a727-kube-api-access-kwnz9\") pod \"network-check-source-dbd9cf844-qwxb9\" (UID: \"75b5ff7d-66bc-463e-ae67-b412a1f5a727\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" Jun 10 19:02:26.892265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.892230 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwnz9\" (UniqueName: \"kubernetes.io/projected/75b5ff7d-66bc-463e-ae67-b412a1f5a727-kube-api-access-kwnz9\") pod \"network-check-source-dbd9cf844-qwxb9\" (UID: \"75b5ff7d-66bc-463e-ae67-b412a1f5a727\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" Jun 10 19:02:26.894769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.894744 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-sfv6h" Jun 10 19:02:26.907398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.907364 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc"] Jun 10 19:02:26.910595 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:26.910548 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71512aa_7d10_49de_bedb_0e8231a5329d.slice/crio-1bfacb2917a4810283baba8266bd01d5b346f6ef808d669ff23d854eea2216da WatchSource:0}: Error finding container 1bfacb2917a4810283baba8266bd01d5b346f6ef808d669ff23d854eea2216da: Status 404 returned error can't find the container with id 1bfacb2917a4810283baba8266bd01d5b346f6ef808d669ff23d854eea2216da Jun 10 19:02:26.929145 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.929109 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm"] Jun 10 19:02:26.932110 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:26.932081 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ae605a_d8c5_4fc0_b1ed_f3363f5bbed0.slice/crio-7f493576643a4a9fd44e9d7b9c17d658648a3243dddc2760e3a3ef571c133ae1 WatchSource:0}: Error finding container 7f493576643a4a9fd44e9d7b9c17d658648a3243dddc2760e3a3ef571c133ae1: Status 404 returned error can't find the container with id 7f493576643a4a9fd44e9d7b9c17d658648a3243dddc2760e3a3ef571c133ae1 Jun 10 19:02:26.964610 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.964537 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj"] Jun 10 19:02:26.966971 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:26.966944 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ad6772_c21e_48fd_b7b7_0f36fda7fd46.slice/crio-8b7efc14f29e768d3e91eda52f040bde192c8631c9fc9a8f0454b198fc8f5573 WatchSource:0}: Error finding container 8b7efc14f29e768d3e91eda52f040bde192c8631c9fc9a8f0454b198fc8f5573: Status 404 returned error can't find the container with id 8b7efc14f29e768d3e91eda52f040bde192c8631c9fc9a8f0454b198fc8f5573 Jun 10 19:02:26.972117 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.972090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" Jun 10 19:02:26.973490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:26.973466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:27.045528 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.045488 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-sfv6h"] Jun 10 19:02:27.048230 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:27.048195 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49142da_6ba2_429f_8d93_bcee57e9b251.slice/crio-45dbaf445ff4b4308c074553df5966fb9405a3727ddd47d749c913478af6c6c0 WatchSource:0}: Error finding container 45dbaf445ff4b4308c074553df5966fb9405a3727ddd47d749c913478af6c6c0: Status 404 returned error can't find the container with id 45dbaf445ff4b4308c074553df5966fb9405a3727ddd47d749c913478af6c6c0 Jun 10 19:02:27.062502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.062465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:27.093543 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.093507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" event={"ID":"50ad6772-c21e-48fd-b7b7-0f36fda7fd46","Type":"ContainerStarted","Data":"8b7efc14f29e768d3e91eda52f040bde192c8631c9fc9a8f0454b198fc8f5573"} Jun 10 19:02:27.094602 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.094557 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" event={"ID":"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0","Type":"ContainerStarted","Data":"7f493576643a4a9fd44e9d7b9c17d658648a3243dddc2760e3a3ef571c133ae1"} Jun 10 19:02:27.095515 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.095496 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-sfv6h" event={"ID":"e49142da-6ba2-429f-8d93-bcee57e9b251","Type":"ContainerStarted","Data":"45dbaf445ff4b4308c074553df5966fb9405a3727ddd47d749c913478af6c6c0"} Jun 10 19:02:27.096469 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.096451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" event={"ID":"e71512aa-7d10-49de-bedb-0e8231a5329d","Type":"ContainerStarted","Data":"1bfacb2917a4810283baba8266bd01d5b346f6ef808d669ff23d854eea2216da"} Jun 10 19:02:27.107599 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.107550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9"] Jun 10 19:02:27.111185 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:27.111155 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b5ff7d_66bc_463e_ae67_b412a1f5a727.slice/crio-536cf46d463c9ca7e6673eca1aa17538d5d19306f5678b3df70eadf017f2e47a WatchSource:0}: Error finding container 536cf46d463c9ca7e6673eca1aa17538d5d19306f5678b3df70eadf017f2e47a: Status 404 returned error can't find the container with id 536cf46d463c9ca7e6673eca1aa17538d5d19306f5678b3df70eadf017f2e47a Jun 10 19:02:27.175108 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.175066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:27.175296 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.175219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:27.175296 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:27.175248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:27.175434 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:27.175250 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:27.175434 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:27.175329 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:27.175434 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:27.175350 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:28.175328931 +0000 UTC m=+211.130293870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:27.175434 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:27.175373 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:28.175363613 +0000 UTC m=+211.130328530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:27.175434 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:27.175388 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:28.175380099 +0000 UTC m=+211.130345016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:28.104386 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.103636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" event={"ID":"75b5ff7d-66bc-463e-ae67-b412a1f5a727","Type":"ContainerStarted","Data":"4f2193c9ecea8d50432d1b3194e170fe00fad87294510343f8dbfbd1da7c9831"} Jun 10 19:02:28.104386 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.103704 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" event={"ID":"75b5ff7d-66bc-463e-ae67-b412a1f5a727","Type":"ContainerStarted","Data":"536cf46d463c9ca7e6673eca1aa17538d5d19306f5678b3df70eadf017f2e47a"} Jun 10 19:02:28.123010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.122900 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-qwxb9" podStartSLOduration=2.122879191 podStartE2EDuration="2.122879191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:28.121700743 +0000 UTC m=+211.076665680" watchObservedRunningTime="2026-06-10 19:02:28.122879191 +0000 UTC m=+211.077844131" Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.187865 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.187915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:28.187990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:28.188150 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:28.188228 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:30.188208558 +0000 UTC m=+213.143173477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:28.188460 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:30.188441293 +0000 UTC m=+213.143406226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:28.188656 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:28.188739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:28.188708 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:30.18869272 +0000 UTC m=+213.143657641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:29.111903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:29.111789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" event={"ID":"e71512aa-7d10-49de-bedb-0e8231a5329d","Type":"ContainerStarted","Data":"30305a24808d127bcfdc8e3087b84bda2fc9de6e46a95aed8b926fedb11d3d94"} Jun 10 19:02:29.224398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:29.224352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:29.324752 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:29.324715 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:30.206942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:30.206896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:30.206942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:30.206950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:30.207008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:30.207140 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:34.207115499 +0000 UTC m=+217.162080426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:30.207192 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:30.207239 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:34.207225111 +0000 UTC m=+217.162190027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:30.207300 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:30.207489 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:30.207356 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:34.207341471 +0000 UTC m=+217.162306389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:31.120058 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.120006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-sfv6h" event={"ID":"e49142da-6ba2-429f-8d93-bcee57e9b251","Type":"ContainerStarted","Data":"7aaad342e7ef687988e6590cfd5e0e6bf1afdee204c181e0796d431720997930"} Jun 10 19:02:31.121559 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.121525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" event={"ID":"50ad6772-c21e-48fd-b7b7-0f36fda7fd46","Type":"ContainerStarted","Data":"d6e5c0fbef8f2c30d513123e2cfa510404a5301e3d9f4c6b081923e82cfe67a7"} Jun 10 19:02:31.123130 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.123110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" event={"ID":"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0","Type":"ContainerStarted","Data":"353eea046c8b7072ab279b38aa54da00c934bf49435e652fed52ae82621745ec"} Jun 10 19:02:31.139531 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.139488 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hlvbc" podStartSLOduration=3.694838122 podStartE2EDuration="5.139472311s" totalImagesPullingTime="1.444634189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:29.127933156 +0000 UTC m=+212.082898095" watchObservedRunningTime="2026-06-10 19:02:31.139472311 +0000 UTC m=+214.094437251" Jun 10 19:02:31.139689 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.139636 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-sfv6h" podStartSLOduration=1.9364122689999999 podStartE2EDuration="5.139631776s" totalImagesPullingTime="3.203219507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:31.138986897 +0000 UTC m=+214.093951837" watchObservedRunningTime="2026-06-10 19:02:31.139631776 +0000 UTC m=+214.094596714" Jun 10 19:02:31.157960 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.157159 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" podStartSLOduration=1.834112696 podStartE2EDuration="5.157140325s" totalImagesPullingTime="3.323027629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:31.155690575 +0000 UTC m=+214.110655524" watchObservedRunningTime="2026-06-10 19:02:31.157140325 +0000 UTC m=+214.112105267" Jun 10 19:02:31.174323 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.174269 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" podStartSLOduration=1.884669358 podStartE2EDuration="5.174248754s" totalImagesPullingTime="3.289579396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:31.173829663 +0000 UTC m=+214.128794604" watchObservedRunningTime="2026-06-10 19:02:31.174248754 +0000 UTC m=+214.129213696" Jun 10 19:02:31.504404 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.504354 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:31.614099 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.614061 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:31.630282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.630245 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw"] Jun 10 19:02:31.633110 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.633090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" Jun 10 19:02:31.636779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.636750 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 19:02:31.637727 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.637708 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wptl9\"" Jun 10 19:02:31.637727 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.637716 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 19:02:31.644372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.644350 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw"] Jun 10 19:02:31.716151 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.716113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:31.720082 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.720052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2l2n\" (UniqueName: \"kubernetes.io/projected/cee371e6-1887-43db-8bb1-b60d996daec9-kube-api-access-x2l2n\") pod \"migrator-955ffdf5f-kb7lw\" (UID: \"cee371e6-1887-43db-8bb1-b60d996daec9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" Jun 10 19:02:31.811977 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.811871 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:31.821210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.821162 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2l2n\" (UniqueName: \"kubernetes.io/projected/cee371e6-1887-43db-8bb1-b60d996daec9-kube-api-access-x2l2n\") pod \"migrator-955ffdf5f-kb7lw\" (UID: \"cee371e6-1887-43db-8bb1-b60d996daec9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" Jun 10 19:02:31.830560 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.830532 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2l2n\" (UniqueName: \"kubernetes.io/projected/cee371e6-1887-43db-8bb1-b60d996daec9-kube-api-access-x2l2n\") pod \"migrator-955ffdf5f-kb7lw\" (UID: \"cee371e6-1887-43db-8bb1-b60d996daec9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" Jun 10 19:02:31.936644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.936603 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:31.943572 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:31.943548 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" Jun 10 19:02:32.003627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:32.003561 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:32.071518 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:32.071432 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw"] Jun 10 19:02:32.074122 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:32.074095 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee371e6_1887_43db_8bb1_b60d996daec9.slice/crio-d1976581fa4cef0488b1b5e24fc0da202073a2bb96c451d533f22726243544cf WatchSource:0}: Error finding container d1976581fa4cef0488b1b5e24fc0da202073a2bb96c451d533f22726243544cf: Status 404 returned error can't find the container with id d1976581fa4cef0488b1b5e24fc0da202073a2bb96c451d533f22726243544cf Jun 10 19:02:32.126846 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:32.126808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" event={"ID":"cee371e6-1887-43db-8bb1-b60d996daec9","Type":"ContainerStarted","Data":"d1976581fa4cef0488b1b5e24fc0da202073a2bb96c451d533f22726243544cf"} Jun 10 19:02:32.210638 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:32.210606 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:32.291404 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:32.291371 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:33.891929 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:33.891891 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:33.993401 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:33.993316 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:34.134849 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.134813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" event={"ID":"cee371e6-1887-43db-8bb1-b60d996daec9","Type":"ContainerStarted","Data":"57829f2d3dfbd91e1f725bceeb9763ffa7c8c877c8d36e94ebf89c64cab08e31"} Jun 10 19:02:34.135037 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.134866 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" event={"ID":"cee371e6-1887-43db-8bb1-b60d996daec9","Type":"ContainerStarted","Data":"892340c3ec47a252a5564220bad640549b986b9db1058ffebc9ad89ccad27086"} Jun 10 19:02:34.166614 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.166544 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-kb7lw" podStartSLOduration=1.500504845 podStartE2EDuration="3.166528746s" totalImagesPullingTime="1.666023901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:34.166415767 +0000 UTC m=+217.121380705" watchObservedRunningTime="2026-06-10 19:02:34.166528746 +0000 UTC m=+217.121493685" Jun 10 19:02:34.242597 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.242554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:34.242775 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.242659 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:34.242775 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.242689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:34.242775 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:34.242762 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:34.242934 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:34.242779 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:34.242934 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:34.242790 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:42.242771498 +0000 UTC m=+225.197736416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:34.242934 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:34.242815 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:42.242808732 +0000 UTC m=+225.197773649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:34.242934 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:34.242829 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:42.242820924 +0000 UTC m=+225.197785840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:34.279551 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.279465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:34.348260 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.348231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:34.348984 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:34.348967 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cjkb_5526f749-875e-415e-a78c-0f7085f53dda/dns-node-resolver/0.log" Jun 10 19:02:35.108702 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:35.108664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:35.349541 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:35.349509 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2pbsn_ec41b10a-79b5-411f-91d7-358481ed6e84/node-ca/0.log" Jun 10 19:02:36.149718 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:36.149691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k67sp_8c5a2208-7ba4-4876-8d7b-b4f3f4917d95/serve-healthcheck-canary/0.log" Jun 10 19:02:36.750230 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:36.750141 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kb7lw_cee371e6-1887-43db-8bb1-b60d996daec9/migrator/0.log" Jun 10 19:02:36.949723 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:36.949688 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kb7lw_cee371e6-1887-43db-8bb1-b60d996daec9/graceful-termination/0.log" Jun 10 19:02:37.149980 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:37.149897 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lktvm_62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0/kube-storage-version-migrator-operator/0.log" Jun 10 19:02:38.119164 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.119127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.275384 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.275354 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.379059 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.378957 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.477256 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.477217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.590500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.590468 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.795514 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.795473 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:38.878959 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:38.878927 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:39.619223 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:39.619192 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:40.225310 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:40.225279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:40.422854 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:40.422820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:40.821988 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:40.821955 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:41.019496 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:41.019462 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:41.419381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:41.419351 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:41.933328 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:41.933287 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:42.059157 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.059122 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:42.222108 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.222025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:42.310990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.310932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:42.311154 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.311048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:42.311154 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.311074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:42.311154 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:42.311082 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 19:02:42.311154 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:42.311147 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert podName:0e52c5b7-771a-4b8c-9df8-85020ffae4c8 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:58.311132744 +0000 UTC m=+241.266097660 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-vkbnm" (UID: "0e52c5b7-771a-4b8c-9df8-85020ffae4c8") : secret "networking-console-plugin-cert" not found Jun 10 19:02:42.311327 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:42.311171 2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 19:02:42.311327 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:42.311199 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:58.311183199 +0000 UTC m=+241.266148129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : configmap references non-existent config key: service-ca.crt Jun 10 19:02:42.311327 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:02:42.311219 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs podName:a405376a-7488-472b-8452-e6598690754d nodeName:}" failed. No retries permitted until 2026-06-10 19:02:58.311211057 +0000 UTC m=+241.266175982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs") pod "router-default-7c4f6d6d85-79t56" (UID: "a405376a-7488-472b-8452-e6598690754d") : secret "router-metrics-certs-default" not found Jun 10 19:02:42.623736 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.623656 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:42.830745 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:42.830707 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:43.036998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:43.036965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:43.428400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:43.428344 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:43.987210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:43.987180 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:44.088216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:44.088183 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:44.416441 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:44.416409 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:44.614458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:44.614429 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:44.720136 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:44.720044 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:45.026170 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:45.026077 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:45.461159 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:45.461126 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:45.648006 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:45.647975 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:45.707567 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:45.707537 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:46.025720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:46.025687 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:46.172431 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:46.172400 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:46.414539 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:46.414502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:46.822831 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:46.822742 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:47.267856 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:47.267823 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:47.616039 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:47.615954 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:47.819045 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:47.819012 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:48.223103 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:48.223066 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:48.624642 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:48.624540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:48.815975 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:48.815937 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:54.445815 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:54.445780 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:54.544100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:54.544060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:54.629346 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:54.629310 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:54.815129 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:54.815046 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:54.976492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:54.976456 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:55.102635 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.102521 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:55.200722 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.200690 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:55.678042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.678011 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-h5qm5"] Jun 10 19:02:55.681336 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.681315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:02:55.687994 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.687768 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 19:02:55.688120 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.688100 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ss4cc\"" Jun 10 19:02:55.688791 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.688777 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 19:02:55.698329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.698301 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-h5qm5"] Jun 10 19:02:55.720948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.720918 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9dzdh"] Jun 10 19:02:55.724040 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.724022 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.726792 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.726771 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv97h\" (UniqueName: \"kubernetes.io/projected/11a1b745-3f58-40ea-ad59-6dc459c0639c-kube-api-access-zv97h\") pod \"downloads-6657875f97-h5qm5\" (UID: \"11a1b745-3f58-40ea-ad59-6dc459c0639c\") " pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:02:55.739061 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.739035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vqmk4\"" Jun 10 19:02:55.739806 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.739790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 19:02:55.740930 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.740912 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 19:02:55.765314 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.765280 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dzdh"] Jun 10 19:02:55.827221 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679b1683-75a6-4761-a95a-d38b19d2cc19-crio-socket\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.827221 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679b1683-75a6-4761-a95a-d38b19d2cc19-data-volume\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.827445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.827445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8krs\" (UniqueName: \"kubernetes.io/projected/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-api-access-l8krs\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.827445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv97h\" (UniqueName: \"kubernetes.io/projected/11a1b745-3f58-40ea-ad59-6dc459c0639c-kube-api-access-zv97h\") pod \"downloads-6657875f97-h5qm5\" (UID: \"11a1b745-3f58-40ea-ad59-6dc459c0639c\") " pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:02:55.827445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.827407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679b1683-75a6-4761-a95a-d38b19d2cc19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.861186 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.861158 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv97h\" (UniqueName: \"kubernetes.io/projected/11a1b745-3f58-40ea-ad59-6dc459c0639c-kube-api-access-zv97h\") pod \"downloads-6657875f97-h5qm5\" (UID: \"11a1b745-3f58-40ea-ad59-6dc459c0639c\") " pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:02:55.920415 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.920376 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:55.928388 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679b1683-75a6-4761-a95a-d38b19d2cc19-crio-socket\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928388 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679b1683-75a6-4761-a95a-d38b19d2cc19-data-volume\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928388 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928668 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8krs\" (UniqueName: \"kubernetes.io/projected/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-api-access-l8krs\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928668 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679b1683-75a6-4761-a95a-d38b19d2cc19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928668 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928442 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/679b1683-75a6-4761-a95a-d38b19d2cc19-crio-socket\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928801 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928747 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/679b1683-75a6-4761-a95a-d38b19d2cc19-data-volume\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.928948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.928932 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.930933 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.930911 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/679b1683-75a6-4761-a95a-d38b19d2cc19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.941779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.941752 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8krs\" (UniqueName: \"kubernetes.io/projected/679b1683-75a6-4761-a95a-d38b19d2cc19-kube-api-access-l8krs\") pod \"insights-runtime-extractor-9dzdh\" (UID: \"679b1683-75a6-4761-a95a-d38b19d2cc19\") " pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:55.990571 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:55.990537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:02:56.016759 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.016717 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:56.032926 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.032887 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dzdh" Jun 10 19:02:56.142620 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.142570 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-h5qm5"] Jun 10 19:02:56.146401 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:56.146350 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a1b745_3f58_40ea_ad59_6dc459c0639c.slice/crio-a1352ff4730b6aa57b89d68e5c37a700c0f40240e9427df6f58add1922bb8413 WatchSource:0}: Error finding container a1352ff4730b6aa57b89d68e5c37a700c0f40240e9427df6f58add1922bb8413: Status 404 returned error can't find the container with id a1352ff4730b6aa57b89d68e5c37a700c0f40240e9427df6f58add1922bb8413 Jun 10 19:02:56.190376 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.190297 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dzdh"] Jun 10 19:02:56.193197 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:56.193170 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679b1683_75a6_4761_a95a_d38b19d2cc19.slice/crio-7f04aafacc65e00905774d8f66fdde934df285f2b969afa8c60b93227edbf7c4 WatchSource:0}: Error finding container 7f04aafacc65e00905774d8f66fdde934df285f2b969afa8c60b93227edbf7c4: Status 404 returned error can't find the container with id 7f04aafacc65e00905774d8f66fdde934df285f2b969afa8c60b93227edbf7c4 Jun 10 19:02:56.202841 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.202813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dzdh" event={"ID":"679b1683-75a6-4761-a95a-d38b19d2cc19","Type":"ContainerStarted","Data":"7f04aafacc65e00905774d8f66fdde934df285f2b969afa8c60b93227edbf7c4"} Jun 10 19:02:56.203883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.203859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-h5qm5" event={"ID":"11a1b745-3f58-40ea-ad59-6dc459c0639c","Type":"ContainerStarted","Data":"a1352ff4730b6aa57b89d68e5c37a700c0f40240e9427df6f58add1922bb8413"} Jun 10 19:02:56.371472 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.371434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:56.534349 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.534251 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:56.618854 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:56.618817 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:57.189959 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:57.189924 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:02:57.210086 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:57.210047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dzdh" event={"ID":"679b1683-75a6-4761-a95a-d38b19d2cc19","Type":"ContainerStarted","Data":"d577c07709083faca8f6b03b516a2cc12388e665f5f4614a8f38894dc0abe133"} Jun 10 19:02:57.210260 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:57.210119 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dzdh" event={"ID":"679b1683-75a6-4761-a95a-d38b19d2cc19","Type":"ContainerStarted","Data":"82681f92ef4c05e04dde0773d61ae20629d476d5b360ceb0b8d8f281b4e6e449"} Jun 10 19:02:58.352824 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.352782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:58.352824 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.352832 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:58.353408 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.352892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:58.353568 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.353540 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a405376a-7488-472b-8452-e6598690754d-service-ca-bundle\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:58.355817 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.355793 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e52c5b7-771a-4b8c-9df8-85020ffae4c8-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-vkbnm\" (UID: \"0e52c5b7-771a-4b8c-9df8-85020ffae4c8\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:58.355934 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.355886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a405376a-7488-472b-8452-e6598690754d-metrics-certs\") pod \"router-default-7c4f6d6d85-79t56\" (UID: \"a405376a-7488-472b-8452-e6598690754d\") " pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:58.584129 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.584091 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cnqvq\"" Jun 10 19:02:58.590951 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.590923 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" Jun 10 19:02:58.596113 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.596079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-67c99\"" Jun 10 19:02:58.603732 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.603496 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:58.985861 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:58.985829 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c4f6d6d85-79t56"] Jun 10 19:02:58.990422 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:58.990390 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda405376a_7488_472b_8452_e6598690754d.slice/crio-23d7e6058e96996f130f6765ca774019f4841db84323d83e02c40492423f62e1 WatchSource:0}: Error finding container 23d7e6058e96996f130f6765ca774019f4841db84323d83e02c40492423f62e1: Status 404 returned error can't find the container with id 23d7e6058e96996f130f6765ca774019f4841db84323d83e02c40492423f62e1 Jun 10 19:02:59.001190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.001165 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm"] Jun 10 19:02:59.004278 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:02:59.004250 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e52c5b7_771a_4b8c_9df8_85020ffae4c8.slice/crio-4022236d7be243671aa022bc472df5b6beac6c06a150806277c033efde167c10 WatchSource:0}: Error finding container 4022236d7be243671aa022bc472df5b6beac6c06a150806277c033efde167c10: Status 404 returned error can't find the container with id 4022236d7be243671aa022bc472df5b6beac6c06a150806277c033efde167c10 Jun 10 19:02:59.219650 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.219614 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" event={"ID":"a405376a-7488-472b-8452-e6598690754d","Type":"ContainerStarted","Data":"84ada7e37330c05c464ccdbfc28ad2bea9fb614443c045b886b94084afe90cab"} Jun 10 19:02:59.219856 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.219676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" event={"ID":"a405376a-7488-472b-8452-e6598690754d","Type":"ContainerStarted","Data":"23d7e6058e96996f130f6765ca774019f4841db84323d83e02c40492423f62e1"} Jun 10 19:02:59.221019 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.220985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" event={"ID":"0e52c5b7-771a-4b8c-9df8-85020ffae4c8","Type":"ContainerStarted","Data":"4022236d7be243671aa022bc472df5b6beac6c06a150806277c033efde167c10"} Jun 10 19:02:59.223474 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.223447 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dzdh" event={"ID":"679b1683-75a6-4761-a95a-d38b19d2cc19","Type":"ContainerStarted","Data":"9ab46f2d1e2c0951af6080997efdbb26811a23147bb726e087f77cdc87fc38b9"} Jun 10 19:02:59.244453 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.244388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" podStartSLOduration=33.244364063 podStartE2EDuration="33.244364063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:59.24249023 +0000 UTC m=+242.197455171" watchObservedRunningTime="2026-06-10 19:02:59.244364063 +0000 UTC m=+242.199329003" Jun 10 19:02:59.264230 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.264175 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9dzdh" podStartSLOduration=1.7116773140000001 podStartE2EDuration="4.264154571s" totalImagesPullingTime="2.552477257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:02:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:59.263294904 +0000 UTC m=+242.218259844" watchObservedRunningTime="2026-06-10 19:02:59.264154571 +0000 UTC m=+242.219119494" Jun 10 19:02:59.604139 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.604035 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:02:59.607372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:02:59.607147 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:03:00.227636 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:00.227572 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:03:00.228869 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:00.228841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c4f6d6d85-79t56" Jun 10 19:03:01.206271 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.206232 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:01.233033 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.232983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" event={"ID":"0e52c5b7-771a-4b8c-9df8-85020ffae4c8","Type":"ContainerStarted","Data":"5580889f01f806c0d82a3f1cb952e3d23b08eede6ecbf8297803f5cb954862dc"} Jun 10 19:03:01.256922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.256851 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-vkbnm" podStartSLOduration=34.012815558 podStartE2EDuration="35.256830297s" totalImagesPullingTime="1.244014739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:01.254606078 +0000 UTC m=+244.209571019" watchObservedRunningTime="2026-06-10 19:03:01.256830297 +0000 UTC m=+244.211795237" Jun 10 19:03:01.307614 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.307561 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:01.412659 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.412618 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:01.492613 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.492494 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:01.724761 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:01.724725 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:02.581448 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.581409 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:02.585904 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.585878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.590180 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.590154 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2nbbw\"" Jun 10 19:03:02.591376 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.591350 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 19:03:02.591499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.591374 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 19:03:02.591499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.591416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 19:03:02.591499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.591485 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 19:03:02.591783 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.591764 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 19:03:02.661218 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.661186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:02.688421 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.688638 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688460 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.688638 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688567 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66hw8\" (UniqueName: \"kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.688638 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.688821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688658 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.688821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.688727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789554 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66hw8\" (UniqueName: \"kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.789769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.789748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.790401 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.790373 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.790513 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.790402 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.790513 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.790473 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.792322 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.792301 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.792802 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.792785 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.806293 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.806260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66hw8\" (UniqueName: \"kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8\") pod \"console-748bbcc44-9542d\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:02.897197 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:02.897106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:03.050591 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:03.050533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:03.053859 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:03.053828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8384528_69c9_4065_a1fe_022dbb458808.slice/crio-d245b9a6acc481da68df91d5c3b28007e087b2eba59635f03461aa5491c3c2b2 WatchSource:0}: Error finding container d245b9a6acc481da68df91d5c3b28007e087b2eba59635f03461aa5491c3c2b2: Status 404 returned error can't find the container with id d245b9a6acc481da68df91d5c3b28007e087b2eba59635f03461aa5491c3c2b2 Jun 10 19:03:03.243253 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:03.243213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748bbcc44-9542d" event={"ID":"d8384528-69c9-4065-a1fe-022dbb458808","Type":"ContainerStarted","Data":"d245b9a6acc481da68df91d5c3b28007e087b2eba59635f03461aa5491c3c2b2"} Jun 10 19:03:05.441215 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:05.441176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:05.555723 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:05.555689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:05.660539 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:05.660502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:06.155063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:06.155018 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:06.239999 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:06.239931 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:07.700378 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:07.700339 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:08.332259 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:08.332221 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:08.410264 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:08.410229 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:09.349424 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.349383 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:03:09.352020 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.351991 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b87dee1-c5f2-4366-8e5c-42f50251a8a4-metrics-certs\") pod \"network-metrics-daemon-txpt2\" (UID: \"3b87dee1-c5f2-4366-8e5c-42f50251a8a4\") " pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:03:09.384043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.384011 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j57pv\"" Jun 10 19:03:09.392014 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.391982 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txpt2" Jun 10 19:03:09.609122 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.609009 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:09.825699 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.825662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:09.869858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.869775 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-89ldj"] Jun 10 19:03:09.872726 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.872700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.874826 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.874798 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj"] Jun 10 19:03:09.875517 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.875488 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 19:03:09.875991 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.875951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 19:03:09.877216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877172 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 19:03:09.877339 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877240 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 19:03:09.877339 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877249 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:09.877339 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877291 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 19:03:09.877490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 19:03:09.877802 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.877783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g56ns\"" Jun 10 19:03:09.881061 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.881039 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 19:03:09.881348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.881329 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 19:03:09.881609 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.881592 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-r5jtj\"" Jun 10 19:03:09.899259 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.899234 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj"] Jun 10 19:03:09.955865 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.955831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsl6h\" (UniqueName: \"kubernetes.io/projected/592b6b22-8d3f-4aa0-851c-0202c376ccb5-kube-api-access-wsl6h\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:09.955865 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.955868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-metrics-client-ca\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.955895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b6b22-8d3f-4aa0-851c-0202c376ccb5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:09.956121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.955941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-sys\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4dd\" (UniqueName: \"kubernetes.io/projected/cdaae407-5011-4e7f-898d-b72d0b336844-kube-api-access-rt4dd\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-root\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-wtmp\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:09.956330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956282 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:09.956330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-textfile\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-tls\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.956561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.956440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-accelerators-collector-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:09.959771 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:09.959745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.057078 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-tls\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-accelerators-collector-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsl6h\" (UniqueName: \"kubernetes.io/projected/592b6b22-8d3f-4aa0-851c-0202c376ccb5-kube-api-access-wsl6h\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057150 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-metrics-client-ca\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b6b22-8d3f-4aa0-851c-0202c376ccb5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057200 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-sys\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4dd\" (UniqueName: \"kubernetes.io/projected/cdaae407-5011-4e7f-898d-b72d0b336844-kube-api-access-rt4dd\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-root\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-wtmp\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057387 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-sys\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.057673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-textfile\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.058023 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-root\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.058023 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-accelerators-collector-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.058023 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.057939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-wtmp\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.058179 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:10.058034 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 19:03:10.058179 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:10.058117 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls podName:592b6b22-8d3f-4aa0-851c-0202c376ccb5 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:10.558095252 +0000 UTC m=+253.513060169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-pgdgj" (UID: "592b6b22-8d3f-4aa0-851c-0202c376ccb5") : secret "openshift-state-metrics-tls" not found Jun 10 19:03:10.058179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.058145 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdaae407-5011-4e7f-898d-b72d0b336844-metrics-client-ca\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.058337 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.058258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/592b6b22-8d3f-4aa0-851c-0202c376ccb5-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.058337 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.058277 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-textfile\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.060308 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.060281 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.060470 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.060446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdaae407-5011-4e7f-898d-b72d0b336844-node-exporter-tls\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.060527 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.060469 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.073307 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.073276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4dd\" (UniqueName: \"kubernetes.io/projected/cdaae407-5011-4e7f-898d-b72d0b336844-kube-api-access-rt4dd\") pod \"node-exporter-89ldj\" (UID: \"cdaae407-5011-4e7f-898d-b72d0b336844\") " pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.075195 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.075170 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsl6h\" (UniqueName: \"kubernetes.io/projected/592b6b22-8d3f-4aa0-851c-0202c376ccb5-kube-api-access-wsl6h\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.100169 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.100098 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.186337 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.186297 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-89ldj" Jun 10 19:03:10.205253 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.205213 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.371887 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.371835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.537660 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.537561 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.561795 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.561757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.564722 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.564696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/592b6b22-8d3f-4aa0-851c-0202c376ccb5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pgdgj\" (UID: \"592b6b22-8d3f-4aa0-851c-0202c376ccb5\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.705546 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.705503 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:10.792131 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.792041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" Jun 10 19:03:10.901310 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:10.901267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:11.011903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.011866 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:11.028216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.028180 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:03:11.031293 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.031269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.037487 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.037463 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 19:03:11.037487 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.037463 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 19:03:11.037715 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.037564 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 19:03:11.037715 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.037645 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 19:03:11.037876 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.037852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 19:03:11.038047 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.038027 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 19:03:11.038103 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.038081 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k9bs5\"" Jun 10 19:03:11.038351 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.038330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 19:03:11.038457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.038446 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 19:03:11.038603 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.038557 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 19:03:11.053802 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.053740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:03:11.168439 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168788 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168788 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168788 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168788 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrwz\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168951 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168951 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.168951 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.169074 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.169074 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.168993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270264 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270229 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270341 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrwz\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270566 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270689 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.270787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.270747 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.271107 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:11.270841 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 19:03:11.271107 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:11.270899 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls podName:9ae575d3-d8d9-4052-a6c8-d5b28166363a nodeName:}" failed. No retries permitted until 2026-06-10 19:03:11.770880017 +0000 UTC m=+254.725844939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a") : secret "alertmanager-main-tls" not found Jun 10 19:03:11.271592 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.271527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.272476 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.272449 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.273518 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.273472 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.274242 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.274213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.274326 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.274270 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.274375 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.274328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.274676 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.274649 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.274798 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.274748 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.275450 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.275407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.275908 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.275889 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.281989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.281964 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrwz\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.342516 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.342430 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:11.776027 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.775986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:11.776456 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:11.776149 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 19:03:11.776456 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:11.776221 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls podName:9ae575d3-d8d9-4052-a6c8-d5b28166363a nodeName:}" failed. No retries permitted until 2026-06-10 19:03:12.77620311 +0000 UTC m=+255.731168027 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a") : secret "alertmanager-main-tls" not found Jun 10 19:03:11.867787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.867751 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:11.988300 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.988268 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59b5447564-hbwq4"] Jun 10 19:03:11.992076 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:11.992046 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.002261 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002238 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 19:03:12.002413 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 19:03:12.002491 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002454 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 19:03:12.003080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002922 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 19:03:12.003080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 19:03:12.003080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.002972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9or7e9mc1uvjo\"" Jun 10 19:03:12.003080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.003038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-sb95w\"" Jun 10 19:03:12.020012 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.019971 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b5447564-hbwq4"] Jun 10 19:03:12.078202 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078374 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078374 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078374 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078268 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1c3746-2411-45a2-8567-e8628bf35995-metrics-client-ca\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqtkt\" (UniqueName: \"kubernetes.io/projected/9e1c3746-2411-45a2-8567-e8628bf35995-kube-api-access-dqtkt\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.078512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.078465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-grpc-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179432 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179396 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqtkt\" (UniqueName: \"kubernetes.io/projected/9e1c3746-2411-45a2-8567-e8628bf35995-kube-api-access-dqtkt\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179513 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-grpc-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179877 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179877 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179710 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.179877 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.179738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1c3746-2411-45a2-8567-e8628bf35995-metrics-client-ca\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.180598 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.180546 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e1c3746-2411-45a2-8567-e8628bf35995-metrics-client-ca\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.182973 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.182937 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.183091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.182988 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-grpc-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.183091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.183028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.183211 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.183119 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-tls\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.183371 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.183351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.184300 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.184281 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9e1c3746-2411-45a2-8567-e8628bf35995-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.188851 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.188829 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqtkt\" (UniqueName: \"kubernetes.io/projected/9e1c3746-2411-45a2-8567-e8628bf35995-kube-api-access-dqtkt\") pod \"thanos-querier-59b5447564-hbwq4\" (UID: \"9e1c3746-2411-45a2-8567-e8628bf35995\") " pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.304170 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.304131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:12.785604 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.785558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:12.788365 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.788341 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:12.844406 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.844362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:03:12.925862 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:12.925767 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:13.032641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:13.032576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:13.107377 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:13.107281 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:13.638807 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:13.638776 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:13.672555 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:13.672515 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdaae407_5011_4e7f_898d_b72d0b336844.slice/crio-a08e612bedf94fcd5795e83fc2141df4b9c31296cb22382b68a9ba8192afc0f0 WatchSource:0}: Error finding container a08e612bedf94fcd5795e83fc2141df4b9c31296cb22382b68a9ba8192afc0f0: Status 404 returned error can't find the container with id a08e612bedf94fcd5795e83fc2141df4b9c31296cb22382b68a9ba8192afc0f0 Jun 10 19:03:13.878796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:13.878761 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b5447564-hbwq4"] Jun 10 19:03:13.881977 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:13.881946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e1c3746_2411_45a2_8567_e8628bf35995.slice/crio-ef6c8952f56a965442d8425d0709cf21a849b5a4b2a813c87872efaab6f670d9 WatchSource:0}: Error finding container ef6c8952f56a965442d8425d0709cf21a849b5a4b2a813c87872efaab6f670d9: Status 404 returned error can't find the container with id ef6c8952f56a965442d8425d0709cf21a849b5a4b2a813c87872efaab6f670d9 Jun 10 19:03:14.090129 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.090006 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj"] Jun 10 19:03:14.092532 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.092503 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txpt2"] Jun 10 19:03:14.094810 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:14.094774 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592b6b22_8d3f_4aa0_851c_0202c376ccb5.slice/crio-5a53a589bbb2696ca8c904847b70f4ce27b52d231188a49735f332f361c32d3c WatchSource:0}: Error finding container 5a53a589bbb2696ca8c904847b70f4ce27b52d231188a49735f332f361c32d3c: Status 404 returned error can't find the container with id 5a53a589bbb2696ca8c904847b70f4ce27b52d231188a49735f332f361c32d3c Jun 10 19:03:14.100274 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.100234 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:03:14.102506 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:14.102483 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae575d3_d8d9_4052_a6c8_d5b28166363a.slice/crio-05ff964fb135655c19c97cd2ad3ca8e1f3b5278e3cf91bc96ae763663011da86 WatchSource:0}: Error finding container 05ff964fb135655c19c97cd2ad3ca8e1f3b5278e3cf91bc96ae763663011da86: Status 404 returned error can't find the container with id 05ff964fb135655c19c97cd2ad3ca8e1f3b5278e3cf91bc96ae763663011da86 Jun 10 19:03:14.291109 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.291004 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"05ff964fb135655c19c97cd2ad3ca8e1f3b5278e3cf91bc96ae763663011da86"} Jun 10 19:03:14.293507 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.293474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-h5qm5" event={"ID":"11a1b745-3f58-40ea-ad59-6dc459c0639c","Type":"ContainerStarted","Data":"44f493314f950b1e0c4970672850aa2834b1e59fdb5813b9e505ebcd2ee7011a"} Jun 10 19:03:14.293846 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.293824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:03:14.296380 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.296352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748bbcc44-9542d" event={"ID":"d8384528-69c9-4065-a1fe-022dbb458808","Type":"ContainerStarted","Data":"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2"} Jun 10 19:03:14.298669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.298620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txpt2" event={"ID":"3b87dee1-c5f2-4366-8e5c-42f50251a8a4","Type":"ContainerStarted","Data":"473d83ece301a6f177d7d02b10865b9e48650b8d5005185e89645a11ef520274"} Jun 10 19:03:14.301412 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.301384 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" event={"ID":"592b6b22-8d3f-4aa0-851c-0202c376ccb5","Type":"ContainerStarted","Data":"5d00f61e0910ff98fb0427c9e5071557cc6496de7408eefbdcd8223043e1d551"} Jun 10 19:03:14.301521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.301446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" event={"ID":"592b6b22-8d3f-4aa0-851c-0202c376ccb5","Type":"ContainerStarted","Data":"ae7d9cb99ae5fe0fbcf0c0c4f01c348039754d76ba054925816acd926d0a4beb"} Jun 10 19:03:14.301521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.301477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" event={"ID":"592b6b22-8d3f-4aa0-851c-0202c376ccb5","Type":"ContainerStarted","Data":"5a53a589bbb2696ca8c904847b70f4ce27b52d231188a49735f332f361c32d3c"} Jun 10 19:03:14.302528 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.302506 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-h5qm5" Jun 10 19:03:14.303694 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.303626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89ldj" event={"ID":"cdaae407-5011-4e7f-898d-b72d0b336844","Type":"ContainerStarted","Data":"a08e612bedf94fcd5795e83fc2141df4b9c31296cb22382b68a9ba8192afc0f0"} Jun 10 19:03:14.305335 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.305315 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"ef6c8952f56a965442d8425d0709cf21a849b5a4b2a813c87872efaab6f670d9"} Jun 10 19:03:14.313752 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.313692 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-h5qm5" podStartSLOduration=1.715432678 podStartE2EDuration="19.313672172s" totalImagesPullingTime="17.598239494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:14.311991478 +0000 UTC m=+257.266956418" watchObservedRunningTime="2026-06-10 19:03:14.313672172 +0000 UTC m=+257.268637112" Jun 10 19:03:14.356598 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.356257 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748bbcc44-9542d" podStartSLOduration=1.7438137120000001 podStartE2EDuration="12.356234628s" totalImagesPullingTime="10.612420916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:14.355621016 +0000 UTC m=+257.310585957" watchObservedRunningTime="2026-06-10 19:03:14.356234628 +0000 UTC m=+257.311199568" Jun 10 19:03:14.671743 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.671704 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:14.681274 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.681139 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:14.681573 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.681547 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx"] Jun 10 19:03:14.685368 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.685344 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.690993 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.690752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 19:03:14.690993 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.690885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4gfnt\"" Jun 10 19:03:14.701057 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.700494 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx"] Jun 10 19:03:14.811887 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.811674 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdmr5\" (UniqueName: \"kubernetes.io/projected/ca5430de-039c-4f62-8f5e-84fef464eecb-kube-api-access-cdmr5\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.811887 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.811743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5430de-039c-4f62-8f5e-84fef464eecb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.827534 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.827457 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:14.912530 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.912487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdmr5\" (UniqueName: \"kubernetes.io/projected/ca5430de-039c-4f62-8f5e-84fef464eecb-kube-api-access-cdmr5\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.913097 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.912553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5430de-039c-4f62-8f5e-84fef464eecb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.916423 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.916367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ca5430de-039c-4f62-8f5e-84fef464eecb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:14.945563 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:14.945477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdmr5\" (UniqueName: \"kubernetes.io/projected/ca5430de-039c-4f62-8f5e-84fef464eecb-kube-api-access-cdmr5\") pod \"monitoring-plugin-76b68cc874-vv2kx\" (UID: \"ca5430de-039c-4f62-8f5e-84fef464eecb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:15.002675 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:15.001790 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:15.044410 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:15.036645 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:15.247160 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:15.247016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx"] Jun 10 19:03:15.316724 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:15.316676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" event={"ID":"ca5430de-039c-4f62-8f5e-84fef464eecb","Type":"ContainerStarted","Data":"311359d78ac4e61578c5f040950bd5f69c4aa845de375f03984b35d6990176e8"} Jun 10 19:03:15.320940 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:15.320677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89ldj" event={"ID":"cdaae407-5011-4e7f-898d-b72d0b336844","Type":"ContainerStarted","Data":"ac0126dff0eda565bc26a2c52300777c3805d58ff7ab2c40dfb23571c2cb353f"} Jun 10 19:03:16.308832 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:16.308773 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:16.326026 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:16.325989 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdaae407-5011-4e7f-898d-b72d0b336844" containerID="ac0126dff0eda565bc26a2c52300777c3805d58ff7ab2c40dfb23571c2cb353f" exitCode=0 Jun 10 19:03:16.326202 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:16.326082 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89ldj" event={"ID":"cdaae407-5011-4e7f-898d-b72d0b336844","Type":"ContainerDied","Data":"ac0126dff0eda565bc26a2c52300777c3805d58ff7ab2c40dfb23571c2cb353f"} Jun 10 19:03:17.435209 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:17.435125 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:17.547648 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:17.547545 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:17.680436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:17.680398 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:17.792027 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:17.791986 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:17.960355 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:17.960301 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:19.346141 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.345559 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txpt2" event={"ID":"3b87dee1-c5f2-4366-8e5c-42f50251a8a4","Type":"ContainerStarted","Data":"0516d7b3df6ce49d6d4e7e6627a0b9809300d8bbb6c83c0b2151de1384485738"} Jun 10 19:03:19.346141 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.345652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txpt2" event={"ID":"3b87dee1-c5f2-4366-8e5c-42f50251a8a4","Type":"ContainerStarted","Data":"0d6392c03932836be00ef4bc60ce2563c97b69bef5639994b78b435f85618da9"} Jun 10 19:03:19.349035 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.348995 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" event={"ID":"592b6b22-8d3f-4aa0-851c-0202c376ccb5","Type":"ContainerStarted","Data":"77f171766a6f9e8e7220c4db4e41e93544a6cbf523169235e31788094e0e99a7"} Jun 10 19:03:19.350914 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.350883 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" event={"ID":"ca5430de-039c-4f62-8f5e-84fef464eecb","Type":"ContainerStarted","Data":"35a15a3954cadd0158e976e17e11407573e0c13decd5b29ce039af4c1784aba5"} Jun 10 19:03:19.351051 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.350936 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:19.354933 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.354905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89ldj" event={"ID":"cdaae407-5011-4e7f-898d-b72d0b336844","Type":"ContainerStarted","Data":"8ec6027bd68fd4413b3084dc3ae0f5cb5e737ffdd39883ac55168e43a182ab58"} Jun 10 19:03:19.355087 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.354957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-89ldj" event={"ID":"cdaae407-5011-4e7f-898d-b72d0b336844","Type":"ContainerStarted","Data":"b89d36a331bf9c6eed62370065be2a46036bbe95313910888c9b75915ed0385c"} Jun 10 19:03:19.357711 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.357679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"66729b20f0aee3f515f4b7a66b5fc7b4b80b38b7e75dddc7f72a790b2c9dbe54"} Jun 10 19:03:19.357843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.357751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"ade802699117c4ba0fe726a34d557ffc3d04d66efdd212c5d61b8202006aa731"} Jun 10 19:03:19.357843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.357794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"df67efe1fc39c8e5fe35dff9aa2b7545e62280fa88debd668fbd5761ec653708"} Jun 10 19:03:19.357948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.357892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" Jun 10 19:03:19.359463 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.359436 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9" exitCode=0 Jun 10 19:03:19.359614 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.359515 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9"} Jun 10 19:03:19.378445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.378387 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txpt2" podStartSLOduration=258.182821261 podStartE2EDuration="4m22.378368472s" totalImagesPullingTime="4.195547211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:19.37761872 +0000 UTC m=+262.332583663" watchObservedRunningTime="2026-06-10 19:03:19.378368472 +0000 UTC m=+262.333333413" Jun 10 19:03:19.424471 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.424399 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-89ldj" podStartSLOduration=8.878647964 podStartE2EDuration="10.424380025s" totalImagesPullingTime="1.406784402s" totalInitContainerRuntime="138.947659ms" isStatefulPod=true podCreationTimestamp="2026-06-10 19:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:19.424134514 +0000 UTC m=+262.379099489" watchObservedRunningTime="2026-06-10 19:03:19.424380025 +0000 UTC m=+262.379344964" Jun 10 19:03:19.466407 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.466345 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vv2kx" podStartSLOduration=1.930771238 podStartE2EDuration="5.466323034s" totalImagesPullingTime="3.535551796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:19.465648466 +0000 UTC m=+262.420613406" watchObservedRunningTime="2026-06-10 19:03:19.466323034 +0000 UTC m=+262.421287952" Jun 10 19:03:19.574176 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.574043 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pgdgj" podStartSLOduration=6.009823459 podStartE2EDuration="10.574018961s" totalImagesPullingTime="4.564195502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:19.573007254 +0000 UTC m=+262.527972195" watchObservedRunningTime="2026-06-10 19:03:19.574018961 +0000 UTC m=+262.528983901" Jun 10 19:03:19.593937 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.593894 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:19.718140 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:19.718098 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:22.381074 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.381029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"0762e6ed16b7c35307418d38c8d5da4d5f26e487e0f70b3af8996a5482b9f329"} Jun 10 19:03:22.381548 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.381110 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"326eaecd9437035dc61823afe8114dab93d19e3b853d8e2f28a3f3b9b9cfa7cb"} Jun 10 19:03:22.381548 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.381149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" event={"ID":"9e1c3746-2411-45a2-8567-e8628bf35995","Type":"ContainerStarted","Data":"4bbbbdec937ce50f93e0b1f59d5065a5f4aa3cd3c9826a13a3537714210cb8f3"} Jun 10 19:03:22.381548 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.381190 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:22.383984 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.383950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7"} Jun 10 19:03:22.384112 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.384029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e"} Jun 10 19:03:22.384112 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.384076 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c"} Jun 10 19:03:22.419839 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.419747 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" podStartSLOduration=3.9622255109999998 podStartE2EDuration="11.419723798s" totalImagesPullingTime="7.457498287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:22.41586709 +0000 UTC m=+265.370832070" watchObservedRunningTime="2026-06-10 19:03:22.419723798 +0000 UTC m=+265.374688738" Jun 10 19:03:22.897635 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:22.897451 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:23.391533 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:23.391492 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852"} Jun 10 19:03:23.392158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:23.391559 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737"} Jun 10 19:03:23.392158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:23.391602 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerStarted","Data":"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa"} Jun 10 19:03:23.436098 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:23.436043 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.207415281 podStartE2EDuration="13.43602252s" totalImagesPullingTime="7.207522953s" totalInitContainerRuntime="21.084286ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:23.434061071 +0000 UTC m=+266.389026010" watchObservedRunningTime="2026-06-10 19:03:23.43602252 +0000 UTC m=+266.390987459" Jun 10 19:03:24.097634 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:24.097598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:24.157178 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:24.157145 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:28.397766 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:28.397736 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59b5447564-hbwq4" Jun 10 19:03:30.216179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:30.216127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:30.303538 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:30.303506 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:33.488173 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:33.488136 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:33.555271 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:33.555237 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:38.973958 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:38.973907 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" Jun 10 19:03:38.973958 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:38.973907 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n6sst" podUID="5f56c490-be16-47ce-9ccf-3795d9b2b34a" Jun 10 19:03:39.453541 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:39.453513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:39.453736 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:39.453513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:03:41.351016 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.350892 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-748bbcc44-9542d" podUID="d8384528-69c9-4065-a1fe-022dbb458808" containerName="console" containerID="cri-o://47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2" gracePeriod=15 Jun 10 19:03:41.462597 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.462547 2580 generic.go:356] "Generic (PLEG): container finished" podID="50ad6772-c21e-48fd-b7b7-0f36fda7fd46" containerID="d6e5c0fbef8f2c30d513123e2cfa510404a5301e3d9f4c6b081923e82cfe67a7" exitCode=0 Jun 10 19:03:41.462762 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.462619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" event={"ID":"50ad6772-c21e-48fd-b7b7-0f36fda7fd46","Type":"ContainerDied","Data":"d6e5c0fbef8f2c30d513123e2cfa510404a5301e3d9f4c6b081923e82cfe67a7"} Jun 10 19:03:41.462943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.462930 2580 scope.go:117] "RemoveContainer" containerID="d6e5c0fbef8f2c30d513123e2cfa510404a5301e3d9f4c6b081923e82cfe67a7" Jun 10 19:03:41.988641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.988599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:03:41.991054 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:41.991031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"image-registry-59f7b7d997-zx2vj\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:03:42.089298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.089248 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:42.091594 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.091564 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f56c490-be16-47ce-9ccf-3795d9b2b34a-metrics-tls\") pod \"dns-default-n6sst\" (UID: \"5f56c490-be16-47ce-9ccf-3795d9b2b34a\") " pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:42.158663 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.158626 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfhcn\"" Jun 10 19:03:42.158847 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.158626 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77lp9\"" Jun 10 19:03:42.164938 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.164905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:03:42.165117 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.164912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:42.376842 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.376808 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 19:03:42.378103 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:42.378075 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22651b6_5bc6_41cb_8810_9d18eff99d93.slice/crio-36f51e84e76d21aded5389f4893e8b1829df8681fea370487f00fa087e4a713f WatchSource:0}: Error finding container 36f51e84e76d21aded5389f4893e8b1829df8681fea370487f00fa087e4a713f: Status 404 returned error can't find the container with id 36f51e84e76d21aded5389f4893e8b1829df8681fea370487f00fa087e4a713f Jun 10 19:03:42.395632 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.395604 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n6sst"] Jun 10 19:03:42.399177 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:03:42.399147 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f56c490_be16_47ce_9ccf_3795d9b2b34a.slice/crio-9d56673a0877f9330e6abc4e6b66b31176707bd75f7cb8f54e8566d9efe63f8b WatchSource:0}: Error finding container 9d56673a0877f9330e6abc4e6b66b31176707bd75f7cb8f54e8566d9efe63f8b: Status 404 returned error can't find the container with id 9d56673a0877f9330e6abc4e6b66b31176707bd75f7cb8f54e8566d9efe63f8b Jun 10 19:03:42.467620 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.467570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n6sst" event={"ID":"5f56c490-be16-47ce-9ccf-3795d9b2b34a","Type":"ContainerStarted","Data":"9d56673a0877f9330e6abc4e6b66b31176707bd75f7cb8f54e8566d9efe63f8b"} Jun 10 19:03:42.468738 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.468710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" event={"ID":"c22651b6-5bc6-41cb-8810-9d18eff99d93","Type":"ContainerStarted","Data":"36f51e84e76d21aded5389f4893e8b1829df8681fea370487f00fa087e4a713f"} Jun 10 19:03:42.470332 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.470305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-wkjjj" event={"ID":"50ad6772-c21e-48fd-b7b7-0f36fda7fd46","Type":"ContainerStarted","Data":"9f30b16e7133f9dcb2f3342d2fc734f3645c59c141e0e838f25694bc97934a96"} Jun 10 19:03:42.963876 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:42.963846 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:43.031561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:43.031528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:43.476403 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:43.476367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" event={"ID":"c22651b6-5bc6-41cb-8810-9d18eff99d93","Type":"ContainerStarted","Data":"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d"} Jun 10 19:03:43.476890 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:43.476470 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:03:43.520482 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:43.520408 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" podStartSLOduration=285.520385368 podStartE2EDuration="4m45.520385368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:43.520327251 +0000 UTC m=+286.475292194" watchObservedRunningTime="2026-06-10 19:03:43.520385368 +0000 UTC m=+286.475350308" Jun 10 19:03:45.487511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:45.487481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n6sst" event={"ID":"5f56c490-be16-47ce-9ccf-3795d9b2b34a","Type":"ContainerStarted","Data":"fc88a4370a25e090997c7ad8ca43a16c7d88784adf36e582a0a9362dcf32d1c0"} Jun 10 19:03:46.493291 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:46.493257 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n6sst" event={"ID":"5f56c490-be16-47ce-9ccf-3795d9b2b34a","Type":"ContainerStarted","Data":"3dc292b4d179135bea472a08e6377e6c82a0f789d594b3c3e3b4d4ac7ca3e80e"} Jun 10 19:03:46.493703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:46.493389 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:46.513931 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:46.513879 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n6sst" podStartSLOduration=252.715922909 podStartE2EDuration="4m15.513861616s" totalImagesPullingTime="2.797938707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:46.511794048 +0000 UTC m=+289.466758988" watchObservedRunningTime="2026-06-10 19:03:46.513861616 +0000 UTC m=+289.468826556" Jun 10 19:03:51.515599 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.515555 2580 generic.go:356] "Generic (PLEG): container finished" podID="62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0" containerID="353eea046c8b7072ab279b38aa54da00c934bf49435e652fed52ae82621745ec" exitCode=0 Jun 10 19:03:51.516136 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.515632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" event={"ID":"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0","Type":"ContainerDied","Data":"353eea046c8b7072ab279b38aa54da00c934bf49435e652fed52ae82621745ec"} Jun 10 19:03:51.516136 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.516070 2580 scope.go:117] "RemoveContainer" containerID="353eea046c8b7072ab279b38aa54da00c934bf49435e652fed52ae82621745ec" Jun 10 19:03:51.517279 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.517255 2580 generic.go:356] "Generic (PLEG): container finished" podID="e49142da-6ba2-429f-8d93-bcee57e9b251" containerID="7aaad342e7ef687988e6590cfd5e0e6bf1afdee204c181e0796d431720997930" exitCode=0 Jun 10 19:03:51.517370 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.517325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-sfv6h" event={"ID":"e49142da-6ba2-429f-8d93-bcee57e9b251","Type":"ContainerDied","Data":"7aaad342e7ef687988e6590cfd5e0e6bf1afdee204c181e0796d431720997930"} Jun 10 19:03:51.517635 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:51.517621 2580 scope.go:117] "RemoveContainer" containerID="7aaad342e7ef687988e6590cfd5e0e6bf1afdee204c181e0796d431720997930" Jun 10 19:03:52.425367 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:52.425331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:52.523549 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:52.523511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-lktvm" event={"ID":"62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0","Type":"ContainerStarted","Data":"9d03e18262c422874599a2da644a5bb00b8b9bf74f3f86609d865084680316ec"} Jun 10 19:03:52.524434 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:52.524409 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:52.525418 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:52.525393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-sfv6h" event={"ID":"e49142da-6ba2-429f-8d93-bcee57e9b251","Type":"ContainerStarted","Data":"6e4a1440f049895f12549aeaad6da65fe028e105b5676481d49ca64325086345"} Jun 10 19:03:54.417832 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:54.417802 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/init-config-reloader/0.log" Jun 10 19:03:54.621959 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:54.621929 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/alertmanager/0.log" Jun 10 19:03:54.820212 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:54.820135 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/config-reloader/0.log" Jun 10 19:03:55.017168 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:55.017139 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/kube-rbac-proxy-web/0.log" Jun 10 19:03:55.220127 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:55.220093 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/kube-rbac-proxy/0.log" Jun 10 19:03:55.417713 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:55.417682 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/kube-rbac-proxy-metric/0.log" Jun 10 19:03:55.630534 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:55.630459 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ae575d3-d8d9-4052-a6c8-d5b28166363a/prom-label-proxy/0.log" Jun 10 19:03:56.498763 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.498731 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n6sst" Jun 10 19:03:56.512428 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.512402 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-748bbcc44-9542d_d8384528-69c9-4065-a1fe-022dbb458808/console/0.log" Jun 10 19:03:56.527413 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.527381 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:56.542801 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542769 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-748bbcc44-9542d_d8384528-69c9-4065-a1fe-022dbb458808/console/0.log" Jun 10 19:03:56.542990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542826 2580 generic.go:356] "Generic (PLEG): container finished" podID="d8384528-69c9-4065-a1fe-022dbb458808" containerID="47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2" exitCode=137 Jun 10 19:03:56.542990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748bbcc44-9542d" event={"ID":"d8384528-69c9-4065-a1fe-022dbb458808","Type":"ContainerDied","Data":"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2"} Jun 10 19:03:56.542990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542894 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748bbcc44-9542d" Jun 10 19:03:56.542990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542920 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748bbcc44-9542d" event={"ID":"d8384528-69c9-4065-a1fe-022dbb458808","Type":"ContainerDied","Data":"d245b9a6acc481da68df91d5c3b28007e087b2eba59635f03461aa5491c3c2b2"} Jun 10 19:03:56.542990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.542947 2580 scope.go:117] "RemoveContainer" containerID="47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2" Jun 10 19:03:56.553827 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.553807 2580 scope.go:117] "RemoveContainer" containerID="47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2" Jun 10 19:03:56.554174 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:03:56.554145 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2\": container with ID starting with 47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2 not found: ID does not exist" containerID="47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2" Jun 10 19:03:56.554242 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.554179 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2"} err="failed to get container status \"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2\": rpc error: code = NotFound desc = could not find container \"47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2\": container with ID starting with 47cd54a7aaa83ca7a22e56c6fe63ecd52481adaa47c8d81ae17000f97ec3adf2 not found: ID does not exist" Jun 10 19:03:56.620460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620370 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620424 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620465 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620550 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66hw8\" (UniqueName: \"kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620655 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620718 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config\") pod \"d8384528-69c9-4065-a1fe-022dbb458808\" (UID: \"d8384528-69c9-4065-a1fe-022dbb458808\") " Jun 10 19:03:56.620943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620849 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config" (OuterVolumeSpecName: "console-config") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:03:56.620943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.620920 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:03:56.621043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.621020 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:03:56.621096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.621052 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-console-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.621096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.621076 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-oauth-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.622957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.622933 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8" (OuterVolumeSpecName: "kube-api-access-66hw8") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "kube-api-access-66hw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:03:56.623100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.623081 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:03:56.623160 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.623096 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8384528-69c9-4065-a1fe-022dbb458808" (UID: "d8384528-69c9-4065-a1fe-022dbb458808"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:03:56.721989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.721945 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-oauth-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.721989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.721982 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8384528-69c9-4065-a1fe-022dbb458808-console-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.721989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.721991 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66hw8\" (UniqueName: \"kubernetes.io/projected/d8384528-69c9-4065-a1fe-022dbb458808-kube-api-access-66hw8\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.721989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.722002 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8384528-69c9-4065-a1fe-022dbb458808-service-ca\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:03:56.820521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.820476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vv2kx_ca5430de-039c-4f62-8f5e-84fef464eecb/monitoring-plugin/0.log" Jun 10 19:03:56.869417 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.869385 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:56.878948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:56.875738 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-748bbcc44-9542d"] Jun 10 19:03:57.016808 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.016778 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/init-textfile/0.log" Jun 10 19:03:57.217631 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.217602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/node-exporter/0.log" Jun 10 19:03:57.416825 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.416787 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/kube-rbac-proxy/0.log" Jun 10 19:03:57.436820 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.436797 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 19:03:57.485129 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.484954 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8384528-69c9-4065-a1fe-022dbb458808" path="/var/lib/kubelet/pods/d8384528-69c9-4065-a1fe-022dbb458808/volumes" Jun 10 19:03:57.892813 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:57.892729 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:03:58.817083 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:58.817038 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/kube-rbac-proxy-main/0.log" Jun 10 19:03:59.017901 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:59.017871 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/kube-rbac-proxy-self/0.log" Jun 10 19:03:59.217050 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:03:59.217024 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/openshift-state-metrics/0.log" Jun 10 19:04:00.618930 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:00.618893 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:00.681142 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:00.681096 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:01.416989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:01.416932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/thanos-query/0.log" Jun 10 19:04:01.619882 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:01.619852 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-web/0.log" Jun 10 19:04:01.817755 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:01.817678 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy/0.log" Jun 10 19:04:01.921839 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:01.921801 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:01.983509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:01.983476 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:02.016797 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.016771 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/prom-label-proxy/0.log" Jun 10 19:04:02.169468 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.169421 2580 patch_prober.go:28] interesting pod/image-registry-59f7b7d997-zx2vj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 19:04:02.169683 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.169492 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:04:02.217625 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.217597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-rules/0.log" Jun 10 19:04:02.418141 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.418110 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-metrics/0.log" Jun 10 19:04:02.618192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:02.618114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-vkbnm_0e52c5b7-771a-4b8c-9df8-85020ffae4c8/networking-console-plugin/0.log" Jun 10 19:04:03.818121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:03.818085 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-h5qm5_11a1b745-3f58-40ea-ad59-6dc459c0639c/download-server/0.log" Jun 10 19:04:04.416481 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:04.416452 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n6sst_5f56c490-be16-47ce-9ccf-3795d9b2b34a/dns/0.log" Jun 10 19:04:04.485661 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:04.485634 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:04:04.616894 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:04.616863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n6sst_5f56c490-be16-47ce-9ccf-3795d9b2b34a/kube-rbac-proxy/0.log" Jun 10 19:04:04.689720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:04.689634 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:04.753159 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:04.753119 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.231735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.231708 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cjkb_5526f749-875e-415e-a78c-0f7085f53dda/dns-node-resolver/0.log" Jun 10 19:04:05.278564 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.278514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.379852 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.379819 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.440741 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.440707 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.661870 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.661843 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.727643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.727611 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:05.816235 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:05.816203 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f7b7d997-zx2vj_c22651b6-5bc6-41cb-8810-9d18eff99d93/registry/0.log" Jun 10 19:04:06.217091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:06.217062 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2pbsn_ec41b10a-79b5-411f-91d7-358481ed6e84/node-ca/0.log" Jun 10 19:04:06.817342 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:06.817312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log" Jun 10 19:04:07.016653 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:07.016626 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k67sp_8c5a2208-7ba4-4876-8d7b-b4f3f4917d95/serve-healthcheck-canary/0.log" Jun 10 19:04:07.860159 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:07.860123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:07.960101 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:07.960059 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:08.022685 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:08.022654 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:08.173137 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:08.173089 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:08.229702 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:08.229672 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:14.659393 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:14.659362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:14.761658 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:14.761622 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:17.319471 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:17.319434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:17.424882 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:17.424847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:23.673377 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:23.673342 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 19:04:23.776085 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:23.776047 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:23.884333 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:23.884299 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:29.434606 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:29.434538 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:29.615674 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:29.615642 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:30.401355 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401315 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:30.401710 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401683 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="alertmanager" containerID="cri-o://ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c" gracePeriod=120 Jun 10 19:04:30.401831 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401763 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-web" containerID="cri-o://882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7" gracePeriod=120 Jun 10 19:04:30.401831 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401758 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-metric" containerID="cri-o://4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737" gracePeriod=120 Jun 10 19:04:30.401831 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401806 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="prom-label-proxy" containerID="cri-o://007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852" gracePeriod=120 Jun 10 19:04:30.401976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401832 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="config-reloader" containerID="cri-o://dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e" gracePeriod=120 Jun 10 19:04:30.401976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.401795 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy" containerID="cri-o://4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa" gracePeriod=120 Jun 10 19:04:30.622427 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.622373 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:30.695420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695384 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852" exitCode=0 Jun 10 19:04:30.695420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695411 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737" exitCode=0 Jun 10 19:04:30.695420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695417 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa" exitCode=0 Jun 10 19:04:30.695420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695424 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e" exitCode=0 Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695432 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c" exitCode=0 Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852"} Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737"} Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa"} Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695622 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e"} Jun 10 19:04:30.695720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.695645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c"} Jun 10 19:04:30.749982 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:30.749935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:31.655921 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.655898 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:31.704448 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.704411 2580 generic.go:356] "Generic (PLEG): container finished" podID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerID="882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7" exitCode=0 Jun 10 19:04:31.704617 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.704505 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:31.704617 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.704493 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7"} Jun 10 19:04:31.704722 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.704681 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ae575d3-d8d9-4052-a6c8-d5b28166363a","Type":"ContainerDied","Data":"05ff964fb135655c19c97cd2ad3ca8e1f3b5278e3cf91bc96ae763663011da86"} Jun 10 19:04:31.704763 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.704740 2580 scope.go:117] "RemoveContainer" containerID="007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852" Jun 10 19:04:31.713930 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.713909 2580 scope.go:117] "RemoveContainer" containerID="4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737" Jun 10 19:04:31.722396 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.722377 2580 scope.go:117] "RemoveContainer" containerID="4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa" Jun 10 19:04:31.729781 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.729760 2580 scope.go:117] "RemoveContainer" containerID="882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7" Jun 10 19:04:31.737964 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.737941 2580 scope.go:117] "RemoveContainer" containerID="dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e" Jun 10 19:04:31.745437 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.745419 2580 scope.go:117] "RemoveContainer" containerID="ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c" Jun 10 19:04:31.752964 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.752945 2580 scope.go:117] "RemoveContainer" containerID="8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9" Jun 10 19:04:31.760195 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.760178 2580 scope.go:117] "RemoveContainer" containerID="007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852" Jun 10 19:04:31.760452 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.760436 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852\": container with ID starting with 007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852 not found: ID does not exist" containerID="007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852" Jun 10 19:04:31.760496 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.760461 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852"} err="failed to get container status \"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852\": rpc error: code = NotFound desc = could not find container \"007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852\": container with ID starting with 007f8dd6cd4817cd45df3174e12d6a92e5140160053b9389cb6820062c966852 not found: ID does not exist" Jun 10 19:04:31.760496 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.760481 2580 scope.go:117] "RemoveContainer" containerID="4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737" Jun 10 19:04:31.760751 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.760719 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737\": container with ID starting with 4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737 not found: ID does not exist" containerID="4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737" Jun 10 19:04:31.760832 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.760753 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737"} err="failed to get container status \"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737\": rpc error: code = NotFound desc = could not find container \"4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737\": container with ID starting with 4bfac0bc466ed6cfba7dc62763efc1feb0fd56d08e60dfdcf745fc5cc2ae7737 not found: ID does not exist" Jun 10 19:04:31.760832 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.760776 2580 scope.go:117] "RemoveContainer" containerID="4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa" Jun 10 19:04:31.761028 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.761010 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa\": container with ID starting with 4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa not found: ID does not exist" containerID="4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa" Jun 10 19:04:31.761065 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761034 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa"} err="failed to get container status \"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa\": rpc error: code = NotFound desc = could not find container \"4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa\": container with ID starting with 4cb7ed8cb5c8c0608ac736f2614e80ec8567e2c6af730ce359743ad00e05d0fa not found: ID does not exist" Jun 10 19:04:31.761065 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761049 2580 scope.go:117] "RemoveContainer" containerID="882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7" Jun 10 19:04:31.761261 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.761244 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7\": container with ID starting with 882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7 not found: ID does not exist" containerID="882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7" Jun 10 19:04:31.761323 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761267 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7"} err="failed to get container status \"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7\": rpc error: code = NotFound desc = could not find container \"882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7\": container with ID starting with 882b4b5d61da0e7cb487837e31761c59428d2417e61d0ffade1c39a359d0c0d7 not found: ID does not exist" Jun 10 19:04:31.761323 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761286 2580 scope.go:117] "RemoveContainer" containerID="dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e" Jun 10 19:04:31.761504 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.761489 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e\": container with ID starting with dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e not found: ID does not exist" containerID="dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e" Jun 10 19:04:31.761542 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761508 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e"} err="failed to get container status \"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e\": rpc error: code = NotFound desc = could not find container \"dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e\": container with ID starting with dc524426b83827e7f2206a966bde6524d553fa14666f2f2985940f8d49f67e0e not found: ID does not exist" Jun 10 19:04:31.761542 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761520 2580 scope.go:117] "RemoveContainer" containerID="ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c" Jun 10 19:04:31.761744 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.761726 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c\": container with ID starting with ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c not found: ID does not exist" containerID="ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c" Jun 10 19:04:31.761858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761752 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c"} err="failed to get container status \"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c\": rpc error: code = NotFound desc = could not find container \"ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c\": container with ID starting with ea6af0c7c9e29fa3790773d5b2ba6061044f30d6a4d1e76bf735807e882f7e7c not found: ID does not exist" Jun 10 19:04:31.761858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761770 2580 scope.go:117] "RemoveContainer" containerID="8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9" Jun 10 19:04:31.761981 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:31.761965 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9\": container with ID starting with 8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9 not found: ID does not exist" containerID="8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9" Jun 10 19:04:31.762018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.761985 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9"} err="failed to get container status \"8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9\": rpc error: code = NotFound desc = could not find container \"8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9\": container with ID starting with 8347475e2450b10ae4dd47b001f6c13e8d416f69fd251433828a68437a6990f9 not found: ID does not exist" Jun 10 19:04:31.833150 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833112 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833161 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtrwz\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833238 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833264 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833288 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.833325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833314 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833705 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833759 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833795 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833854 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833904 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.833942 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle\") pod \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\" (UID: \"9ae575d3-d8d9-4052-a6c8-d5b28166363a\") " Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.834291 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:31.834372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.834314 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:04:31.834927 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.834669 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:31.835667 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.835201 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.835667 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.835231 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ae575d3-d8d9-4052-a6c8-d5b28166363a-metrics-client-ca\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.835667 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.835248 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-alertmanager-main-db\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.836328 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.836303 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume" (OuterVolumeSpecName: "config-volume") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.836514 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.836474 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out" (OuterVolumeSpecName: "config-out") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:04:31.836514 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.836492 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.836807 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.836770 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz" (OuterVolumeSpecName: "kube-api-access-dtrwz") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "kube-api-access-dtrwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:31.836915 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.836890 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:31.837162 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.837145 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.838113 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.838094 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.838264 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.838248 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.841135 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.841109 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.848358 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.848334 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config" (OuterVolumeSpecName: "web-config") pod "9ae575d3-d8d9-4052-a6c8-d5b28166363a" (UID: "9ae575d3-d8d9-4052-a6c8-d5b28166363a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:31.935775 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935731 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-web-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935775 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935770 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-out\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935786 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-main-tls\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935801 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-tls-assets\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935816 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935834 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935851 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-cluster-tls-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935866 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935881 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ae575d3-d8d9-4052-a6c8-d5b28166363a-config-volume\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:31.935981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:31.935895 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtrwz\" (UniqueName: \"kubernetes.io/projected/9ae575d3-d8d9-4052-a6c8-d5b28166363a-kube-api-access-dtrwz\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:32.029812 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.029777 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:32.034571 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.034539 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:32.067702 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.067646 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:32.068004 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.067983 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="init-config-reloader" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068006 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="init-config-reloader" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068015 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068022 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068032 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-web" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068038 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-web" Jun 10 19:04:32.068053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068051 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-metric" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068057 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-metric" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068064 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="prom-label-proxy" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068069 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="prom-label-proxy" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068076 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="alertmanager" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068081 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="alertmanager" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068088 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="config-reloader" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068094 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="config-reloader" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068100 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8384528-69c9-4065-a1fe-022dbb458808" containerName="console" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068105 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8384528-69c9-4065-a1fe-022dbb458808" containerName="console" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068152 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8384528-69c9-4065-a1fe-022dbb458808" containerName="console" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068159 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="prom-label-proxy" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068167 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="config-reloader" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068175 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="alertmanager" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068182 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068188 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-metric" Jun 10 19:04:32.068245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.068194 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" containerName="kube-rbac-proxy-web" Jun 10 19:04:32.071719 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.071691 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.076205 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 19:04:32.076340 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076315 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 19:04:32.076392 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076364 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 19:04:32.076490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076450 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 19:04:32.076490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076465 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 19:04:32.076660 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-k9bs5\"" Jun 10 19:04:32.077018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 19:04:32.077018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.077003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 19:04:32.077153 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.076993 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 19:04:32.082368 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.082348 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 19:04:32.088821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.088786 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:32.237281 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-web-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237281 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237363 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237379 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-889nk\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-kube-api-access-889nk\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-config-out\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-config-volume\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.237787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.237641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338331 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-config-out\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338331 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-config-volume\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338331 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338357 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-web-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-889nk\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-kube-api-access-889nk\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.338883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.338804 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.339533 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.339504 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.340830 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.340801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c681fcd5-877b-4aae-a44d-f35565304950-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341356 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c681fcd5-877b-4aae-a44d-f35565304950-config-out\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341501 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-web-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341600 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341501 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341708 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341826 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341682 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-config-volume\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341826 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341732 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.341941 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.341929 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.343021 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.343002 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.343340 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.343325 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c681fcd5-877b-4aae-a44d-f35565304950-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.347975 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.347950 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-889nk\" (UniqueName: \"kubernetes.io/projected/c681fcd5-877b-4aae-a44d-f35565304950-kube-api-access-889nk\") pod \"alertmanager-main-0\" (UID: \"c681fcd5-877b-4aae-a44d-f35565304950\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.382057 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.382018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 19:04:32.528329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.528002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 19:04:32.530868 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:04:32.530840 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc681fcd5_877b_4aae_a44d_f35565304950.slice/crio-5570db5fa0050ea658ac046d951df3150e56711a07e05448cab6355714c90dfa WatchSource:0}: Error finding container 5570db5fa0050ea658ac046d951df3150e56711a07e05448cab6355714c90dfa: Status 404 returned error can't find the container with id 5570db5fa0050ea658ac046d951df3150e56711a07e05448cab6355714c90dfa Jun 10 19:04:32.711106 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.711074 2580 generic.go:356] "Generic (PLEG): container finished" podID="c681fcd5-877b-4aae-a44d-f35565304950" containerID="854666347daa726db6ffe244f2f5fcc13c36741291abe80d2dcec2c6749fea28" exitCode=0 Jun 10 19:04:32.711483 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.711122 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerDied","Data":"854666347daa726db6ffe244f2f5fcc13c36741291abe80d2dcec2c6749fea28"} Jun 10 19:04:32.711483 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:32.711173 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"5570db5fa0050ea658ac046d951df3150e56711a07e05448cab6355714c90dfa"} Jun 10 19:04:33.484726 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.484691 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ae575d3-d8d9-4052-a6c8-d5b28166363a" path="/var/lib/kubelet/pods/9ae575d3-d8d9-4052-a6c8-d5b28166363a/volumes" Jun 10 19:04:33.719192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719155 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"eb850fd429df81e77c0621caf44527fd34a5599259ebb36f7aae2c4e94044075"} Jun 10 19:04:33.719686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"35aecf566f2a8d2e36ab376c0a690bf5f719cfc9d2d794c7541d65c78553d0f7"} Jun 10 19:04:33.719686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"cd3b6667e60aaaaf82a030e2534c600d4acb05b668a9ecf8f4cee731be9ecde8"} Jun 10 19:04:33.719686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719270 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"f0fd293986e65fcfce1da64bec31ccb6a36150bc88f1ae161869ec42765b9d8a"} Jun 10 19:04:33.719686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"feefe661daadc87c94e01b3e71632bb070e352ffbc82d2b5a373711f4027cde7"} Jun 10 19:04:33.719686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.719319 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c681fcd5-877b-4aae-a44d-f35565304950","Type":"ContainerStarted","Data":"e889faad156596ac707f7c2043667fe2d669809fd892604b2a8036a3c714ed40"} Jun 10 19:04:33.752045 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:33.751931 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.730703796 podStartE2EDuration="1.751910001s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.206205ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:04:33.750876947 +0000 UTC m=+336.705841887" watchObservedRunningTime="2026-06-10 19:04:33.751910001 +0000 UTC m=+336.706874940" Jun 10 19:04:34.542155 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.542116 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6865f76b6f-6tnmd"] Jun 10 19:04:34.545998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.545981 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.549258 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.549234 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 19:04:34.549505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.549486 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kkkrt\"" Jun 10 19:04:34.549551 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.549524 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 19:04:34.550202 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.550182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 19:04:34.550458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.550443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 19:04:34.550530 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.550475 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 19:04:34.558329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.558302 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 19:04:34.563861 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.563826 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6865f76b6f-6tnmd"] Jun 10 19:04:34.657749 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657714 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.657749 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk996\" (UniqueName: \"kubernetes.io/projected/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-kube-api-access-jk996\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.657948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-federate-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.657948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.657948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-metrics-client-ca\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.658047 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.657974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.658047 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.658018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-serving-certs-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.658109 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.658056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.758787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758743 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.758787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk996\" (UniqueName: \"kubernetes.io/projected/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-kube-api-access-jk996\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-federate-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-metrics-client-ca\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.758994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.759033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-serving-certs-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759870 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.759832 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-metrics-client-ca\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.759835 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-serving-certs-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.759957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.759907 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.762173 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.762147 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.762292 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.762207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-telemeter-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.762292 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.762257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.762384 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.762303 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-federate-client-tls\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.771329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.771302 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk996\" (UniqueName: \"kubernetes.io/projected/6f5dd1f0-fb72-4086-846e-c34bc7cdb97c-kube-api-access-jk996\") pod \"telemeter-client-6865f76b6f-6tnmd\" (UID: \"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c\") " pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:34.856034 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:34.855935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" Jun 10 19:04:35.045022 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:35.044997 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6865f76b6f-6tnmd"] Jun 10 19:04:35.047144 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:04:35.047121 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5dd1f0_fb72_4086_846e_c34bc7cdb97c.slice/crio-7569424ba86389b127ba0ed7dd831bbaaf9b33409f24c5ce5e7812cc8e2d9c9c WatchSource:0}: Error finding container 7569424ba86389b127ba0ed7dd831bbaaf9b33409f24c5ce5e7812cc8e2d9c9c: Status 404 returned error can't find the container with id 7569424ba86389b127ba0ed7dd831bbaaf9b33409f24c5ce5e7812cc8e2d9c9c Jun 10 19:04:35.049266 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:35.049244 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:04:35.729238 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:35.729198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" event={"ID":"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c","Type":"ContainerStarted","Data":"7569424ba86389b127ba0ed7dd831bbaaf9b33409f24c5ce5e7812cc8e2d9c9c"} Jun 10 19:04:37.740148 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:37.740112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" event={"ID":"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c","Type":"ContainerStarted","Data":"eb2496c5d792ca5e0ae2d3fc209246e5c8c34f5bf4b23e461a71f34d43fb3e79"} Jun 10 19:04:37.740512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:37.740172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" event={"ID":"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c","Type":"ContainerStarted","Data":"4d1cc32ac86fb0ca96a61e6784860cb9008bc2a9551bfa74afac4fd14646ae51"} Jun 10 19:04:37.740512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:37.740191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" event={"ID":"6f5dd1f0-fb72-4086-846e-c34bc7cdb97c","Type":"ContainerStarted","Data":"3406ce8ecf17cce6929d7ddc686183b257dcb1dd292a7375511f814a527ff027"} Jun 10 19:04:37.765044 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:37.764993 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6865f76b6f-6tnmd" podStartSLOduration=1.4684914629999999 podStartE2EDuration="3.764977186s" totalImagesPullingTime="2.296485723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:04:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:04:37.763601282 +0000 UTC m=+340.718566211" watchObservedRunningTime="2026-06-10 19:04:37.764977186 +0000 UTC m=+340.719942129" Jun 10 19:04:38.470461 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.470425 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:04:38.474017 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.473998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.479234 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.479207 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 19:04:38.480740 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.480398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 19:04:38.480740 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.480626 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 19:04:38.480740 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.480676 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2nbbw\"" Jun 10 19:04:38.480922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.480841 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 19:04:38.481018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.481000 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 19:04:38.489765 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.489739 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 19:04:38.493124 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493097 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493261 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493261 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzsr\" (UniqueName: \"kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493518 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.493882 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.493856 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:04:38.575928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.575858 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:38.593950 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.593917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594120 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.593980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594120 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzsr\" (UniqueName: \"kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594120 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594120 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594317 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594317 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594767 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.594899 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594766 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.595010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.594986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.595183 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.595161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.596701 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.596678 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.596788 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.596774 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.607114 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.607091 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzsr\" (UniqueName: \"kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr\") pod \"console-7d9b7c5c54-j7nkw\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.678625 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.678562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:38.784128 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.784034 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:38.789970 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.789946 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:38.931128 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:38.931103 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:04:38.934506 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:04:38.934478 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345510ce_53a7_463b_b5e9_30ade3232411.slice/crio-741c260dc36cb3e0f0b4ec35ca2eced2d7ae51617947bb7328bfd8692cadad90 WatchSource:0}: Error finding container 741c260dc36cb3e0f0b4ec35ca2eced2d7ae51617947bb7328bfd8692cadad90: Status 404 returned error can't find the container with id 741c260dc36cb3e0f0b4ec35ca2eced2d7ae51617947bb7328bfd8692cadad90 Jun 10 19:04:39.253803 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:39.253769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:39.323567 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:39.323529 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:39.750818 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:39.750782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9b7c5c54-j7nkw" event={"ID":"345510ce-53a7-463b-b5e9-30ade3232411","Type":"ContainerStarted","Data":"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890"} Jun 10 19:04:39.750984 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:39.750830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9b7c5c54-j7nkw" event={"ID":"345510ce-53a7-463b-b5e9-30ade3232411","Type":"ContainerStarted","Data":"741c260dc36cb3e0f0b4ec35ca2eced2d7ae51617947bb7328bfd8692cadad90"} Jun 10 19:04:39.774170 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:39.774110 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d9b7c5c54-j7nkw" podStartSLOduration=1.774094209 podStartE2EDuration="1.774094209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:04:39.771552129 +0000 UTC m=+342.726517068" watchObservedRunningTime="2026-06-10 19:04:39.774094209 +0000 UTC m=+342.729059147" Jun 10 19:04:45.622135 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:45.622040 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:45.722381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:45.722348 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:48.700967 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:48.700914 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerName="registry" containerID="cri-o://b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d" gracePeriod=30 Jun 10 19:04:48.784258 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:48.784206 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:48.784445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:48.784293 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:48.789866 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:48.789843 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:48.960742 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:48.960676 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:04:49.086849 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.086810 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087039 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.086867 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46hrv\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087039 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.086888 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087039 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.086977 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087039 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087005 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087045 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087136 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration\") pod \"c22651b6-5bc6-41cb-8810-9d18eff99d93\" (UID: \"c22651b6-5bc6-41cb-8810-9d18eff99d93\") " Jun 10 19:04:49.087402 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087384 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:49.087453 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087410 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:49.087453 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.087448 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-trusted-ca\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.089575 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.089495 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv" (OuterVolumeSpecName: "kube-api-access-46hrv") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "kube-api-access-46hrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:49.089575 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.089498 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:49.089793 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.089746 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:49.089936 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.089916 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:49.090034 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.090014 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:49.095331 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.095306 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c22651b6-5bc6-41cb-8810-9d18eff99d93" (UID: "c22651b6-5bc6-41cb-8810-9d18eff99d93"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:04:49.188696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188658 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-installation-pull-secrets\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188690 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46hrv\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-kube-api-access-46hrv\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188702 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-certificates\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188713 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c22651b6-5bc6-41cb-8810-9d18eff99d93-ca-trust-extracted\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188722 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-bound-sa-token\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188731 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c22651b6-5bc6-41cb-8810-9d18eff99d93-registry-tls\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.188942 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.188739 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c22651b6-5bc6-41cb-8810-9d18eff99d93-image-registry-private-configuration\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:04:49.794262 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.794174 2580 generic.go:356] "Generic (PLEG): container finished" podID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerID="b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d" exitCode=0 Jun 10 19:04:49.794262 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.794221 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" Jun 10 19:04:49.794734 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.794253 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" event={"ID":"c22651b6-5bc6-41cb-8810-9d18eff99d93","Type":"ContainerDied","Data":"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d"} Jun 10 19:04:49.794734 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.794310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f7b7d997-zx2vj" event={"ID":"c22651b6-5bc6-41cb-8810-9d18eff99d93","Type":"ContainerDied","Data":"36f51e84e76d21aded5389f4893e8b1829df8681fea370487f00fa087e4a713f"} Jun 10 19:04:49.794734 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.794340 2580 scope.go:117] "RemoveContainer" containerID="b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d" Jun 10 19:04:49.798795 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.798769 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:04:49.803400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.803380 2580 scope.go:117] "RemoveContainer" containerID="b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d" Jun 10 19:04:49.803718 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:04:49.803691 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d\": container with ID starting with b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d not found: ID does not exist" containerID="b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d" Jun 10 19:04:49.803762 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.803728 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d"} err="failed to get container status \"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d\": rpc error: code = NotFound desc = could not find container \"b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d\": container with ID starting with b9ea913e58548272fd1456813906497872bdf48408db867860563663766fa19d not found: ID does not exist" Jun 10 19:04:49.816345 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.816318 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 19:04:49.821755 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:49.821720 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59f7b7d997-zx2vj"] Jun 10 19:04:50.029734 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:50.029699 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:50.129657 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:50.129552 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:50.230212 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:50.230184 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:04:51.490519 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:04:51.490485 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" path="/var/lib/kubelet/pods/c22651b6-5bc6-41cb-8810-9d18eff99d93/volumes" Jun 10 19:05:22.431271 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:22.431231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:22.530961 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:22.530929 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:44.643093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:44.643051 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:44.708474 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:44.708438 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:54.647839 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.647807 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:05:54.648303 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.648156 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerName="registry" Jun 10 19:05:54.648303 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.648169 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerName="registry" Jun 10 19:05:54.648303 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.648232 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22651b6-5bc6-41cb-8810-9d18eff99d93" containerName="registry" Jun 10 19:05:54.654743 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.654714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.672055 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.672013 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:05:54.706070 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.706036 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:54.759240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759199 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759245 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759342 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46wfg\" (UniqueName: \"kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759445 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.759650 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.759474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.779213 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.779176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:54.860791 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.860791 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860871 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46wfg\" (UniqueName: \"kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.860943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861738 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.861712 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861875 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.861798 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861875 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.861798 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.861993 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.861870 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.863477 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.863446 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.863614 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.863521 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.871992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.871967 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46wfg\" (UniqueName: \"kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg\") pod \"console-b6b4654bd-mf7kx\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:54.964129 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:54.964097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:05:55.108660 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:55.108625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:05:55.112513 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:05:55.112471 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d3a584_e040_4801_8dd0_a94c3949a7ea.slice/crio-c118ead3ccb8184f6c79ec3b4192d39b518309e0d105c623bc7ad4b95a75c3d8 WatchSource:0}: Error finding container c118ead3ccb8184f6c79ec3b4192d39b518309e0d105c623bc7ad4b95a75c3d8: Status 404 returned error can't find the container with id c118ead3ccb8184f6c79ec3b4192d39b518309e0d105c623bc7ad4b95a75c3d8 Jun 10 19:05:56.085333 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:56.085288 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4654bd-mf7kx" event={"ID":"96d3a584-e040-4801-8dd0-a94c3949a7ea","Type":"ContainerStarted","Data":"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118"} Jun 10 19:05:56.085744 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:56.085346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4654bd-mf7kx" event={"ID":"96d3a584-e040-4801-8dd0-a94c3949a7ea","Type":"ContainerStarted","Data":"c118ead3ccb8184f6c79ec3b4192d39b518309e0d105c623bc7ad4b95a75c3d8"} Jun 10 19:05:56.106599 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:56.106525 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b6b4654bd-mf7kx" podStartSLOduration=2.106506827 podStartE2EDuration="2.106506827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:05:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:05:56.105097246 +0000 UTC m=+419.060062186" watchObservedRunningTime="2026-06-10 19:05:56.106506827 +0000 UTC m=+419.061471765" Jun 10 19:05:56.642823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:56.642790 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:05:56.743147 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:05:56.743117 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:00.696512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:00.696475 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:00.841482 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:00.841431 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:01.095279 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:01.095194 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:04.964673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:04.964633 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:06:04.965063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:04.964971 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:06:04.969730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:04.969704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:06:05.132339 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:05.132310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:06:05.182366 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:05.182329 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:06:05.311741 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:05.311651 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:05.417710 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:05.417674 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:05.517922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:05.517881 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:30.204191 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.204087 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d9b7c5c54-j7nkw" podUID="345510ce-53a7-463b-b5e9-30ade3232411" containerName="console" containerID="cri-o://8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890" gracePeriod=15 Jun 10 19:06:30.454003 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.453977 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:06:30.565756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565659 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.565756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565717 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.565756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565749 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.566043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565775 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.566043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565800 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.566043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565823 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wzsr\" (UniqueName: \"kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.566043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.565861 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config\") pod \"345510ce-53a7-463b-b5e9-30ade3232411\" (UID: \"345510ce-53a7-463b-b5e9-30ade3232411\") " Jun 10 19:06:30.566240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.566120 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca" (OuterVolumeSpecName: "service-ca") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:06:30.566308 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.566275 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config" (OuterVolumeSpecName: "console-config") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:06:30.566366 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.566310 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:06:30.566366 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.566288 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:06:30.568077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.568052 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:06:30.568203 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.568075 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:06:30.568203 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.568088 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr" (OuterVolumeSpecName: "kube-api-access-6wzsr") pod "345510ce-53a7-463b-b5e9-30ade3232411" (UID: "345510ce-53a7-463b-b5e9-30ade3232411"). InnerVolumeSpecName "kube-api-access-6wzsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:06:30.666867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666808 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-service-ca\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.666867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666857 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-console-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.666867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666868 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-oauth-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.666867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666878 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.666867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666887 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/345510ce-53a7-463b-b5e9-30ade3232411-trusted-ca-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.667184 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666896 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wzsr\" (UniqueName: \"kubernetes.io/projected/345510ce-53a7-463b-b5e9-30ade3232411-kube-api-access-6wzsr\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:30.667184 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:30.666905 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/345510ce-53a7-463b-b5e9-30ade3232411-console-oauth-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:06:31.240068 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.240016 2580 generic.go:356] "Generic (PLEG): container finished" podID="345510ce-53a7-463b-b5e9-30ade3232411" containerID="8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890" exitCode=0 Jun 10 19:06:31.240068 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.240069 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9b7c5c54-j7nkw" Jun 10 19:06:31.240505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.240093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9b7c5c54-j7nkw" event={"ID":"345510ce-53a7-463b-b5e9-30ade3232411","Type":"ContainerDied","Data":"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890"} Jun 10 19:06:31.240505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.240137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9b7c5c54-j7nkw" event={"ID":"345510ce-53a7-463b-b5e9-30ade3232411","Type":"ContainerDied","Data":"741c260dc36cb3e0f0b4ec35ca2eced2d7ae51617947bb7328bfd8692cadad90"} Jun 10 19:06:31.240505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.240160 2580 scope.go:117] "RemoveContainer" containerID="8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890" Jun 10 19:06:31.249760 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.249742 2580 scope.go:117] "RemoveContainer" containerID="8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890" Jun 10 19:06:31.250042 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:06:31.250020 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890\": container with ID starting with 8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890 not found: ID does not exist" containerID="8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890" Jun 10 19:06:31.250140 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.250048 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890"} err="failed to get container status \"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890\": rpc error: code = NotFound desc = could not find container \"8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890\": container with ID starting with 8c864d1652b220357cfc1f5f17fc15da5f7178d477d472515c658c3648958890 not found: ID does not exist" Jun 10 19:06:31.262520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.262493 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:06:31.266525 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.266498 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9b7c5c54-j7nkw"] Jun 10 19:06:31.485398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:31.485364 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="345510ce-53a7-463b-b5e9-30ade3232411" path="/var/lib/kubelet/pods/345510ce-53a7-463b-b5e9-30ade3232411/volumes" Jun 10 19:06:46.789710 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:46.789671 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:06:47.738133 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:06:47.738089 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:07:07.842623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:07.842562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:07:39.273101 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:39.273063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:07:42.346778 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:42.346734 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:07:42.491847 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:42.491816 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:07:43.616010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.615929 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78"] Jun 10 19:07:43.616372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.616328 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="345510ce-53a7-463b-b5e9-30ade3232411" containerName="console" Jun 10 19:07:43.616372 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.616343 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="345510ce-53a7-463b-b5e9-30ade3232411" containerName="console" Jun 10 19:07:43.616441 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.616400 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="345510ce-53a7-463b-b5e9-30ade3232411" containerName="console" Jun 10 19:07:43.619561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.619542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.624395 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.624367 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:07:43.624806 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.624790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:07:43.625628 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.625608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:07:43.637632 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.637598 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78"] Jun 10 19:07:43.700703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.700663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.700879 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.700749 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5wjs\" (UniqueName: \"kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.700879 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.700794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.801968 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.801920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5wjs\" (UniqueName: \"kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.802178 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.801997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.802178 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.802024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.802409 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.802384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.802474 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.802411 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.811901 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.811867 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5wjs\" (UniqueName: \"kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:43.928982 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:43.928934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:07:44.070856 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:44.070831 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78"] Jun 10 19:07:44.073151 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:07:44.073124 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bc3b34_d3cb_4c45_be07_969890f88751.slice/crio-90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364 WatchSource:0}: Error finding container 90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364: Status 404 returned error can't find the container with id 90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364 Jun 10 19:07:44.556954 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:44.556909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" event={"ID":"d7bc3b34-d3cb-4c45-be07-969890f88751","Type":"ContainerStarted","Data":"90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364"} Jun 10 19:07:54.604676 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:54.604637 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerID="0b6e85c449b9ed0fde597b96a25964ec6353a14fd308acfec7daee9e813bd123" exitCode=0 Jun 10 19:07:54.605066 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:54.604723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" event={"ID":"d7bc3b34-d3cb-4c45-be07-969890f88751","Type":"ContainerDied","Data":"0b6e85c449b9ed0fde597b96a25964ec6353a14fd308acfec7daee9e813bd123"} Jun 10 19:07:57.620264 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:57.620231 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerID="a3ab89186d930045461d225cf44e89776dce1985aa60b07e888ae03156b68bcf" exitCode=0 Jun 10 19:07:57.620656 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:07:57.620313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" event={"ID":"d7bc3b34-d3cb-4c45-be07-969890f88751","Type":"ContainerDied","Data":"a3ab89186d930045461d225cf44e89776dce1985aa60b07e888ae03156b68bcf"} Jun 10 19:08:08.675273 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:08.675226 2580 generic.go:356] "Generic (PLEG): container finished" podID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerID="f52de4e207d9456618f8dc81f6b544ec80004083e552e0301e9b55357235ab2a" exitCode=0 Jun 10 19:08:08.675736 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:08.675303 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" event={"ID":"d7bc3b34-d3cb-4c45-be07-969890f88751","Type":"ContainerDied","Data":"f52de4e207d9456618f8dc81f6b544ec80004083e552e0301e9b55357235ab2a"} Jun 10 19:08:09.820873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.820845 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:08:09.933226 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.933133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle\") pod \"d7bc3b34-d3cb-4c45-be07-969890f88751\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " Jun 10 19:08:09.933473 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.933232 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5wjs\" (UniqueName: \"kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs\") pod \"d7bc3b34-d3cb-4c45-be07-969890f88751\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " Jun 10 19:08:09.933473 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.933291 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util\") pod \"d7bc3b34-d3cb-4c45-be07-969890f88751\" (UID: \"d7bc3b34-d3cb-4c45-be07-969890f88751\") " Jun 10 19:08:09.933948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.933924 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle" (OuterVolumeSpecName: "bundle") pod "d7bc3b34-d3cb-4c45-be07-969890f88751" (UID: "d7bc3b34-d3cb-4c45-be07-969890f88751"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:09.935623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.935595 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs" (OuterVolumeSpecName: "kube-api-access-j5wjs") pod "d7bc3b34-d3cb-4c45-be07-969890f88751" (UID: "d7bc3b34-d3cb-4c45-be07-969890f88751"). InnerVolumeSpecName "kube-api-access-j5wjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:08:09.938772 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:09.938741 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util" (OuterVolumeSpecName: "util") pod "d7bc3b34-d3cb-4c45-be07-969890f88751" (UID: "d7bc3b34-d3cb-4c45-be07-969890f88751"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:10.034455 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.034400 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5wjs\" (UniqueName: \"kubernetes.io/projected/d7bc3b34-d3cb-4c45-be07-969890f88751-kube-api-access-j5wjs\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:10.034455 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.034453 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:10.034455 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.034467 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7bc3b34-d3cb-4c45-be07-969890f88751-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:10.685657 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.685618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" event={"ID":"d7bc3b34-d3cb-4c45-be07-969890f88751","Type":"ContainerDied","Data":"90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364"} Jun 10 19:08:10.685657 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.685645 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dq5z78" Jun 10 19:08:10.685873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:10.685678 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90f527054ddb20ff1263064f1ca8d68d31482e3d5f30366329f34c60b90df364" Jun 10 19:08:14.690972 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:14.690907 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:15.514178 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:15.514140 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:16.848996 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.848961 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff"] Jun 10 19:08:16.849381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849350 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="extract" Jun 10 19:08:16.849381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849361 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="extract" Jun 10 19:08:16.849381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849370 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="pull" Jun 10 19:08:16.849381 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849375 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="pull" Jun 10 19:08:16.849509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849387 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="util" Jun 10 19:08:16.849509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849393 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="util" Jun 10 19:08:16.849509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.849449 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7bc3b34-d3cb-4c45-be07-969890f88751" containerName="extract" Jun 10 19:08:16.851502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.851486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:16.854539 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.854515 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 19:08:16.854714 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.854557 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7rvfm\"" Jun 10 19:08:16.854714 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.854680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:08:16.867661 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.867631 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff"] Jun 10 19:08:16.892531 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.892493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eba1e4d5-c9d2-4565-8915-d540ee93a595-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:16.892720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.892543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsnhj\" (UniqueName: \"kubernetes.io/projected/eba1e4d5-c9d2-4565-8915-d540ee93a595-kube-api-access-tsnhj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:16.993404 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.993354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eba1e4d5-c9d2-4565-8915-d540ee93a595-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:16.993549 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.993426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsnhj\" (UniqueName: \"kubernetes.io/projected/eba1e4d5-c9d2-4565-8915-d540ee93a595-kube-api-access-tsnhj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:16.993858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:16.993839 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eba1e4d5-c9d2-4565-8915-d540ee93a595-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:17.007990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:17.007957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsnhj\" (UniqueName: \"kubernetes.io/projected/eba1e4d5-c9d2-4565-8915-d540ee93a595-kube-api-access-tsnhj\") pod \"cert-manager-operator-controller-manager-57757f7cfc-rp9ff\" (UID: \"eba1e4d5-c9d2-4565-8915-d540ee93a595\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:17.160839 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:17.160812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" Jun 10 19:08:17.317606 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:17.317566 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff"] Jun 10 19:08:17.320443 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:17.320415 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba1e4d5_c9d2_4565_8915_d540ee93a595.slice/crio-d39bd25e255948c6fd2b1ae327d962a5ff1d2d112cef7d9a3026b9f850a38df1 WatchSource:0}: Error finding container d39bd25e255948c6fd2b1ae327d962a5ff1d2d112cef7d9a3026b9f850a38df1: Status 404 returned error can't find the container with id d39bd25e255948c6fd2b1ae327d962a5ff1d2d112cef7d9a3026b9f850a38df1 Jun 10 19:08:17.722337 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:17.722301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" event={"ID":"eba1e4d5-c9d2-4565-8915-d540ee93a595","Type":"ContainerStarted","Data":"d39bd25e255948c6fd2b1ae327d962a5ff1d2d112cef7d9a3026b9f850a38df1"} Jun 10 19:08:18.509636 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:18.509595 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:18.610077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:18.610035 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:19.733421 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:19.733381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" event={"ID":"eba1e4d5-c9d2-4565-8915-d540ee93a595","Type":"ContainerStarted","Data":"01dcc66eeabc5d40d288afe881e00536d2c244eedde2d9f72e7391b540ec307d"} Jun 10 19:08:19.760852 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:19.760800 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:19.884536 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:19.884498 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:20.230750 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.230717 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:20.368883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.368851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:20.892928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.892873 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-rp9ff" podStartSLOduration=3.226741094 podStartE2EDuration="4.892854106s" totalImagesPullingTime="1.666113012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:08:19.789476205 +0000 UTC m=+562.744441145" watchObservedRunningTime="2026-06-10 19:08:20.892854106 +0000 UTC m=+563.847819045" Jun 10 19:08:20.893346 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.893331 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs"] Jun 10 19:08:20.897091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.897073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:20.900681 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.900658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:08:20.901844 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.901825 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:08:20.901910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.901840 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:08:20.917835 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:20.917799 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs"] Jun 10 19:08:21.027663 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.027621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ql7n\" (UniqueName: \"kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.027873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.027678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.027873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.027705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.128740 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.128698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ql7n\" (UniqueName: \"kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.128960 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.128755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.128960 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.128783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.129216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.129193 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.129292 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.129226 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.141219 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.141184 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ql7n\" (UniqueName: \"kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.206261 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.206229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:21.346914 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.346876 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs"] Jun 10 19:08:21.350164 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:21.350132 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7b710a_a08b_4018_8e65_d85c7cc4e535.slice/crio-631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f WatchSource:0}: Error finding container 631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f: Status 404 returned error can't find the container with id 631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f Jun 10 19:08:21.744498 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.744397 2580 generic.go:356] "Generic (PLEG): container finished" podID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerID="622612008d0159063fd20b77c4df1f9fdd81bb1f757de4c0e3808aee53cb13d9" exitCode=0 Jun 10 19:08:21.744498 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.744442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" event={"ID":"4a7b710a-a08b-4018-8e65-d85c7cc4e535","Type":"ContainerDied","Data":"622612008d0159063fd20b77c4df1f9fdd81bb1f757de4c0e3808aee53cb13d9"} Jun 10 19:08:21.744498 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.744479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" event={"ID":"4a7b710a-a08b-4018-8e65-d85c7cc4e535","Type":"ContainerStarted","Data":"631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f"} Jun 10 19:08:21.977779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.977747 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-h75b6"] Jun 10 19:08:21.980214 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.980194 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:21.982987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.982962 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 19:08:21.983119 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.982965 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-zcjcg\"" Jun 10 19:08:21.983119 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.983021 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 19:08:21.990354 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:21.990331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-h75b6"] Jun 10 19:08:22.036512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.036415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.036512 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.036494 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r579t\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-kube-api-access-r579t\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.136924 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.136892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.137099 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.136949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r579t\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-kube-api-access-r579t\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.145415 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.145379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.145814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.145793 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r579t\" (UniqueName: \"kubernetes.io/projected/2c59c3cf-0982-4896-9b68-d73eab5c9a7f-kube-api-access-r579t\") pod \"cert-manager-webhook-7dc76cbb94-h75b6\" (UID: \"2c59c3cf-0982-4896-9b68-d73eab5c9a7f\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.308672 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.308539 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:22.461622 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.461570 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-h75b6"] Jun 10 19:08:22.465647 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:22.465611 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c59c3cf_0982_4896_9b68_d73eab5c9a7f.slice/crio-2094ba454e67d4ee700dcafbb40843aa7338de45952c082f894751d4dd5e30fa WatchSource:0}: Error finding container 2094ba454e67d4ee700dcafbb40843aa7338de45952c082f894751d4dd5e30fa: Status 404 returned error can't find the container with id 2094ba454e67d4ee700dcafbb40843aa7338de45952c082f894751d4dd5e30fa Jun 10 19:08:22.480665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.480633 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:22.751950 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:22.751909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" event={"ID":"2c59c3cf-0982-4896-9b68-d73eab5c9a7f","Type":"ContainerStarted","Data":"2094ba454e67d4ee700dcafbb40843aa7338de45952c082f894751d4dd5e30fa"} Jun 10 19:08:23.194491 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:23.194463 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:23.594709 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:23.594622 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:24.765689 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:24.765644 2580 generic.go:356] "Generic (PLEG): container finished" podID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerID="433e75d6d2a213a494cc1fe20b0b5eb6069e3c835d2887d8db0a21731637f497" exitCode=0 Jun 10 19:08:24.766144 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:24.765705 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" event={"ID":"4a7b710a-a08b-4018-8e65-d85c7cc4e535","Type":"ContainerDied","Data":"433e75d6d2a213a494cc1fe20b0b5eb6069e3c835d2887d8db0a21731637f497"} Jun 10 19:08:25.310304 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:25.310274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:25.379253 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:25.379217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:25.772600 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:25.772557 2580 generic.go:356] "Generic (PLEG): container finished" podID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerID="09cd5832332c1137d013e657a88d467a1bb109c47a5fff6906e0f7ac8cb1f6ee" exitCode=0 Jun 10 19:08:25.772956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:25.772624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" event={"ID":"4a7b710a-a08b-4018-8e65-d85c7cc4e535","Type":"ContainerDied","Data":"09cd5832332c1137d013e657a88d467a1bb109c47a5fff6906e0f7ac8cb1f6ee"} Jun 10 19:08:26.778776 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.778733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" event={"ID":"2c59c3cf-0982-4896-9b68-d73eab5c9a7f","Type":"ContainerStarted","Data":"b0e978f860a1de6cd9038b910bf89ac105d9f0734450afb9a20e8c3f7fa2f9b2"} Jun 10 19:08:26.779239 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.779036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:26.797022 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.796959 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" podStartSLOduration=2.527847686 podStartE2EDuration="5.796935097s" totalImagesPullingTime="3.269087411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:08:26.795305672 +0000 UTC m=+569.750270610" watchObservedRunningTime="2026-06-10 19:08:26.796935097 +0000 UTC m=+569.751900039" Jun 10 19:08:26.916103 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.916076 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:26.982046 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.982007 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle\") pod \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " Jun 10 19:08:26.982248 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.982062 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ql7n\" (UniqueName: \"kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n\") pod \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " Jun 10 19:08:26.982248 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.982154 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util\") pod \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\" (UID: \"4a7b710a-a08b-4018-8e65-d85c7cc4e535\") " Jun 10 19:08:26.982492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.982458 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle" (OuterVolumeSpecName: "bundle") pod "4a7b710a-a08b-4018-8e65-d85c7cc4e535" (UID: "4a7b710a-a08b-4018-8e65-d85c7cc4e535"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:26.984249 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.984224 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n" (OuterVolumeSpecName: "kube-api-access-6ql7n") pod "4a7b710a-a08b-4018-8e65-d85c7cc4e535" (UID: "4a7b710a-a08b-4018-8e65-d85c7cc4e535"). InnerVolumeSpecName "kube-api-access-6ql7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:08:26.986522 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:26.986501 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util" (OuterVolumeSpecName: "util") pod "4a7b710a-a08b-4018-8e65-d85c7cc4e535" (UID: "4a7b710a-a08b-4018-8e65-d85c7cc4e535"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:27.083928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.083820 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:27.083928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.083869 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ql7n\" (UniqueName: \"kubernetes.io/projected/4a7b710a-a08b-4018-8e65-d85c7cc4e535-kube-api-access-6ql7n\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:27.083928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.083879 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a7b710a-a08b-4018-8e65-d85c7cc4e535-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:27.784998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.784915 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" Jun 10 19:08:27.784998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.784942 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh57fs" event={"ID":"4a7b710a-a08b-4018-8e65-d85c7cc4e535","Type":"ContainerDied","Data":"631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f"} Jun 10 19:08:27.784998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:27.784988 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="631ea6192691a253e55d8e5f59b8d551132f06719d0a21c7c39155779058d23f" Jun 10 19:08:29.406804 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:29.406764 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:29.478891 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:29.478842 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:30.800461 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:30.800424 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:31.125058 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.124977 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-4q98d"] Jun 10 19:08:31.125369 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125357 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="util" Jun 10 19:08:31.125411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125371 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="util" Jun 10 19:08:31.125411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125379 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="pull" Jun 10 19:08:31.125411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125385 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="pull" Jun 10 19:08:31.125411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125404 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="extract" Jun 10 19:08:31.125411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125410 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="extract" Jun 10 19:08:31.125560 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.125465 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a7b710a-a08b-4018-8e65-d85c7cc4e535" containerName="extract" Jun 10 19:08:31.128766 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.128749 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.131349 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.131324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-lsvm7\"" Jun 10 19:08:31.138397 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.138375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-4q98d"] Jun 10 19:08:31.221663 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.221621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtq8l\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-kube-api-access-wtq8l\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.221663 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.221670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-bound-sa-token\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.323252 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.323215 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtq8l\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-kube-api-access-wtq8l\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.323416 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.323258 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-bound-sa-token\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.331462 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.331428 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtq8l\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-kube-api-access-wtq8l\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.331720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.331700 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8540d5a5-06f7-4226-ae2e-d3146bcc0a3d-bound-sa-token\") pod \"cert-manager-59c77684cc-4q98d\" (UID: \"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d\") " pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.438703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.438673 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-4q98d" Jun 10 19:08:31.582247 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.582181 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-4q98d"] Jun 10 19:08:31.585065 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:31.585025 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8540d5a5_06f7_4226_ae2e_d3146bcc0a3d.slice/crio-9edc35ac3986a2c6f678bc0f583008ab340c4da19c4cb8c5bf28573cfb8dcc94 WatchSource:0}: Error finding container 9edc35ac3986a2c6f678bc0f583008ab340c4da19c4cb8c5bf28573cfb8dcc94: Status 404 returned error can't find the container with id 9edc35ac3986a2c6f678bc0f583008ab340c4da19c4cb8c5bf28573cfb8dcc94 Jun 10 19:08:31.807537 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.807441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-4q98d" event={"ID":"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d","Type":"ContainerStarted","Data":"9dd8eabeed022da26f86f870b5a7a07e59a3281247e05fc53199c68b2db2292e"} Jun 10 19:08:31.807537 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.807488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-4q98d" event={"ID":"8540d5a5-06f7-4226-ae2e-d3146bcc0a3d","Type":"ContainerStarted","Data":"9edc35ac3986a2c6f678bc0f583008ab340c4da19c4cb8c5bf28573cfb8dcc94"} Jun 10 19:08:31.825472 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:31.825410 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-4q98d" podStartSLOduration=0.825390447 podStartE2EDuration="825.390447ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:08:31.824843818 +0000 UTC m=+574.779808749" watchObservedRunningTime="2026-06-10 19:08:31.825390447 +0000 UTC m=+574.780355390" Jun 10 19:08:32.788167 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:32.788139 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-h75b6" Jun 10 19:08:35.092210 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:35.092148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:35.195442 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:35.195396 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:35.716251 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:35.716204 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:35.806894 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:35.806862 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:36.736251 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:36.736144 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:36.841361 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:36.841331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:42.179642 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:42.179608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:42.284227 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:42.284197 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:44.061090 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:44.061059 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:45.194564 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.194526 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd"] Jun 10 19:08:45.197118 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.197102 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.200040 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.200012 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:08:45.200189 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.200094 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:08:45.201360 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.201338 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:08:45.207487 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.207451 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd"] Jun 10 19:08:45.350806 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.350773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.350987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.350822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdnt8\" (UniqueName: \"kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.350987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.350909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.451657 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.451550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdnt8\" (UniqueName: \"kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.451811 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.451660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.451811 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.451703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.452139 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.452117 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.452180 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.452132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.461501 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.461474 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdnt8\" (UniqueName: \"kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.506832 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.506791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:45.642837 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.642808 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd"] Jun 10 19:08:45.645381 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:45.645352 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5fc827_40ce_406e_b977_8d4dec99d7db.slice/crio-5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb WatchSource:0}: Error finding container 5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb: Status 404 returned error can't find the container with id 5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb Jun 10 19:08:45.875058 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.875022 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerID="c7f331f89b1222f3cd6ca3db7fa47d3edce62b848448ad40df965ad798c7f01e" exitCode=0 Jun 10 19:08:45.875244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.875117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" event={"ID":"3c5fc827-40ce-406e-b977-8d4dec99d7db","Type":"ContainerDied","Data":"c7f331f89b1222f3cd6ca3db7fa47d3edce62b848448ad40df965ad798c7f01e"} Jun 10 19:08:45.875244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:45.875177 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" event={"ID":"3c5fc827-40ce-406e-b977-8d4dec99d7db","Type":"ContainerStarted","Data":"5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb"} Jun 10 19:08:46.881955 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:46.881856 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerID="90dd425dc23f3542bccf40198b9528269a6c69bce7f2cef331ef822fe5ad67a3" exitCode=0 Jun 10 19:08:46.881955 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:46.881928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" event={"ID":"3c5fc827-40ce-406e-b977-8d4dec99d7db","Type":"ContainerDied","Data":"90dd425dc23f3542bccf40198b9528269a6c69bce7f2cef331ef822fe5ad67a3"} Jun 10 19:08:47.889749 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:47.889710 2580 generic.go:356] "Generic (PLEG): container finished" podID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerID="203a930af0ceeb43b74ebad6d8532a143a05d18fde34ac6612622374b3bcd680" exitCode=0 Jun 10 19:08:47.890167 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:47.889781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" event={"ID":"3c5fc827-40ce-406e-b977-8d4dec99d7db","Type":"ContainerDied","Data":"203a930af0ceeb43b74ebad6d8532a143a05d18fde34ac6612622374b3bcd680"} Jun 10 19:08:49.024319 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.024292 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:49.081876 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.081843 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle\") pod \"3c5fc827-40ce-406e-b977-8d4dec99d7db\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " Jun 10 19:08:49.082042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.081909 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdnt8\" (UniqueName: \"kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8\") pod \"3c5fc827-40ce-406e-b977-8d4dec99d7db\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " Jun 10 19:08:49.082042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.081960 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util\") pod \"3c5fc827-40ce-406e-b977-8d4dec99d7db\" (UID: \"3c5fc827-40ce-406e-b977-8d4dec99d7db\") " Jun 10 19:08:49.082598 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.082558 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle" (OuterVolumeSpecName: "bundle") pod "3c5fc827-40ce-406e-b977-8d4dec99d7db" (UID: "3c5fc827-40ce-406e-b977-8d4dec99d7db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:49.084063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.084042 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8" (OuterVolumeSpecName: "kube-api-access-fdnt8") pod "3c5fc827-40ce-406e-b977-8d4dec99d7db" (UID: "3c5fc827-40ce-406e-b977-8d4dec99d7db"). InnerVolumeSpecName "kube-api-access-fdnt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:08:49.087280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.087245 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util" (OuterVolumeSpecName: "util") pod "3c5fc827-40ce-406e-b977-8d4dec99d7db" (UID: "3c5fc827-40ce-406e-b977-8d4dec99d7db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:08:49.182494 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.182458 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:49.182494 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.182487 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c5fc827-40ce-406e-b977-8d4dec99d7db-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:49.182494 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.182497 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdnt8\" (UniqueName: \"kubernetes.io/projected/3c5fc827-40ce-406e-b977-8d4dec99d7db-kube-api-access-fdnt8\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:08:49.900746 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.900665 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" Jun 10 19:08:49.900896 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.900660 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd859fd" event={"ID":"3c5fc827-40ce-406e-b977-8d4dec99d7db","Type":"ContainerDied","Data":"5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb"} Jun 10 19:08:49.900896 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:49.900809 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cca28b0d135616bdac7353ba27b7e3941c0c0b6ed0724ee83f1bf55828f64fb" Jun 10 19:08:56.559624 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:56.559559 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:56.664377 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:56.664333 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:57.132506 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.132465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:57.610627 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.610492 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:57.714683 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.714648 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:57.780764 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.780728 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz"] Jun 10 19:08:57.781112 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781100 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="util" Jun 10 19:08:57.781158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781113 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="util" Jun 10 19:08:57.781158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781120 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="pull" Jun 10 19:08:57.781158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781127 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="pull" Jun 10 19:08:57.781158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781139 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="extract" Jun 10 19:08:57.781158 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781144 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="extract" Jun 10 19:08:57.781339 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.781197 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5fc827-40ce-406e-b977-8d4dec99d7db" containerName="extract" Jun 10 19:08:57.783353 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.783336 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.788433 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.788402 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 19:08:57.788433 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.788428 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 19:08:57.788654 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.788430 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hkg4t\"" Jun 10 19:08:57.788654 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.788485 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 19:08:57.788654 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.788430 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 19:08:57.807505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.807481 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz"] Jun 10 19:08:57.848575 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.848543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.848774 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.848621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzgb4\" (UniqueName: \"kubernetes.io/projected/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-kube-api-access-mzgb4\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.848774 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.848679 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.848774 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.848719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.848940 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.848773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.949833 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.949797 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.950065 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.949858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.950065 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.950029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.950179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.950145 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.950179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.950169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzgb4\" (UniqueName: \"kubernetes.io/projected/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-kube-api-access-mzgb4\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.950590 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.950537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.952286 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.952253 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.952510 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.952493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.952639 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.952617 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.958886 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.958868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzgb4\" (UniqueName: \"kubernetes.io/projected/5b91036e-38aa-4e2f-8ea6-9fa965ae220a-kube-api-access-mzgb4\") pod \"opendatahub-operator-controller-manager-5d769b9458-4ptsz\" (UID: \"5b91036e-38aa-4e2f-8ea6-9fa965ae220a\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:57.979555 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:57.979525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:58.084901 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.084864 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:58.094377 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.094348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:08:58.184254 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.184219 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:58.249042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.249016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz"] Jun 10 19:08:58.250728 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:08:58.250690 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b91036e_38aa_4e2f_8ea6_9fa965ae220a.slice/crio-dc2ad63241050a113a2351e3dee053130707b36a2d6753a2bb5f40eb5e9ac86e WatchSource:0}: Error finding container dc2ad63241050a113a2351e3dee053130707b36a2d6753a2bb5f40eb5e9ac86e: Status 404 returned error can't find the container with id dc2ad63241050a113a2351e3dee053130707b36a2d6753a2bb5f40eb5e9ac86e Jun 10 19:08:58.284387 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.284349 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:58.470393 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.470350 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:08:58.946990 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:08:58.946956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" event={"ID":"5b91036e-38aa-4e2f-8ea6-9fa965ae220a","Type":"ContainerStarted","Data":"dc2ad63241050a113a2351e3dee053130707b36a2d6753a2bb5f40eb5e9ac86e"} Jun 10 19:09:01.973257 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:01.973217 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" event={"ID":"5b91036e-38aa-4e2f-8ea6-9fa965ae220a","Type":"ContainerStarted","Data":"f0f2819bf7d72a40c3ad5af774f035ae79681116ba2bd0505cb68c58c9818943"} Jun 10 19:09:02.980197 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:02.980158 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b91036e-38aa-4e2f-8ea6-9fa965ae220a" containerID="f0f2819bf7d72a40c3ad5af774f035ae79681116ba2bd0505cb68c58c9818943" exitCode=0 Jun 10 19:09:02.980650 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:02.980248 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" event={"ID":"5b91036e-38aa-4e2f-8ea6-9fa965ae220a","Type":"ContainerDied","Data":"f0f2819bf7d72a40c3ad5af774f035ae79681116ba2bd0505cb68c58c9818943"} Jun 10 19:09:03.986792 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:03.986753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" event={"ID":"5b91036e-38aa-4e2f-8ea6-9fa965ae220a","Type":"ContainerStarted","Data":"6a96e23124dcc37d6f3e4216c5c855a433a8cd09259c1dce04764c6f0a30fc6b"} Jun 10 19:09:03.987187 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:03.986881 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:09:04.014114 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:04.014066 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" podStartSLOduration=2.6368855780000002 podStartE2EDuration="7.014047429s" totalImagesPullingTime="3.293795649s" totalInitContainerRuntime="1.083366202s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:04.011654264 +0000 UTC m=+606.966619196" watchObservedRunningTime="2026-06-10 19:09:04.014047429 +0000 UTC m=+606.969012367" Jun 10 19:09:08.168359 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:08.168326 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:09.280222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:09.280187 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:14.994223 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:14.994142 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-4ptsz" Jun 10 19:09:16.727873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:16.727835 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:16.869859 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:16.869825 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:17.094828 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.094745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:17.223956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.223919 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z"] Jun 10 19:09:17.230751 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.230727 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.237901 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.237879 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 19:09:17.238981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.238965 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 19:09:17.262894 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.262862 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z"] Jun 10 19:09:17.321360 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.321327 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4njp\" (UniqueName: \"kubernetes.io/projected/561c9e55-05d6-476b-9203-c9c15e210c22-kube-api-access-f4njp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.321527 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.321404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c9e55-05d6-476b-9203-c9c15e210c22-tls-certs\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.321527 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.321436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c9e55-05d6-476b-9203-c9c15e210c22-tmp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.338456 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.338430 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:17.422963 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.422929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c9e55-05d6-476b-9203-c9c15e210c22-tls-certs\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.423153 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.422975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c9e55-05d6-476b-9203-c9c15e210c22-tmp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.423153 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.423011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4njp\" (UniqueName: \"kubernetes.io/projected/561c9e55-05d6-476b-9203-c9c15e210c22-kube-api-access-f4njp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.425300 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.425261 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561c9e55-05d6-476b-9203-c9c15e210c22-tmp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.425623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.425604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/561c9e55-05d6-476b-9203-c9c15e210c22-tls-certs\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.452681 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.452646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4njp\" (UniqueName: \"kubernetes.io/projected/561c9e55-05d6-476b-9203-c9c15e210c22-kube-api-access-f4njp\") pod \"kube-auth-proxy-755b69b8fb-8pp5z\" (UID: \"561c9e55-05d6-476b-9203-c9c15e210c22\") " pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.496328 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.496288 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:17.540594 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.540558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" Jun 10 19:09:17.725390 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.725362 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z"] Jun 10 19:09:17.727400 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:17.727360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561c9e55_05d6_476b_9203_c9c15e210c22.slice/crio-4a93ebf7b80657b4bbce2c41a73a5713e2ccd55eda7fa1a20c675aae75d57339 WatchSource:0}: Error finding container 4a93ebf7b80657b4bbce2c41a73a5713e2ccd55eda7fa1a20c675aae75d57339: Status 404 returned error can't find the container with id 4a93ebf7b80657b4bbce2c41a73a5713e2ccd55eda7fa1a20c675aae75d57339 Jun 10 19:09:17.756441 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.756412 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p52bk"] Jun 10 19:09:17.779056 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.779020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p52bk"] Jun 10 19:09:17.779186 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.779136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.782502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.782480 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 10 19:09:17.783045 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.783031 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2sjwx\"" Jun 10 19:09:17.826400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.826358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kdb8\" (UniqueName: \"kubernetes.io/projected/bf04193d-baa8-4a89-a605-5cafccff7ec5-kube-api-access-2kdb8\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.826400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.826408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.896876 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.896847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:17.927666 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.927628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kdb8\" (UniqueName: \"kubernetes.io/projected/bf04193d-baa8-4a89-a605-5cafccff7ec5-kube-api-access-2kdb8\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.927666 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.927671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.927875 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:17.927836 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 19:09:17.927913 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:17.927895 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert podName:bf04193d-baa8-4a89-a605-5cafccff7ec5 nodeName:}" failed. No retries permitted until 2026-06-10 19:09:18.427874421 +0000 UTC m=+621.382839350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert") pod "odh-model-controller-6dc94f689f-p52bk" (UID: "bf04193d-baa8-4a89-a605-5cafccff7ec5") : secret "odh-model-controller-webhook-cert" not found Jun 10 19:09:17.937244 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.937211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kdb8\" (UniqueName: \"kubernetes.io/projected/bf04193d-baa8-4a89-a605-5cafccff7ec5-kube-api-access-2kdb8\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:17.983722 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:17.983608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:18.057320 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.057280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" event={"ID":"561c9e55-05d6-476b-9203-c9c15e210c22","Type":"ContainerStarted","Data":"4a93ebf7b80657b4bbce2c41a73a5713e2ccd55eda7fa1a20c675aae75d57339"} Jun 10 19:09:18.082872 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.082840 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:18.431952 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.431917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:18.432156 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:18.432111 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 10 19:09:18.432225 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:18.432187 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert podName:bf04193d-baa8-4a89-a605-5cafccff7ec5 nodeName:}" failed. No retries permitted until 2026-06-10 19:09:19.432165871 +0000 UTC m=+622.387130792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert") pod "odh-model-controller-6dc94f689f-p52bk" (UID: "bf04193d-baa8-4a89-a605-5cafccff7ec5") : secret "odh-model-controller-webhook-cert" not found Jun 10 19:09:18.569565 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.569515 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:18.630804 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.630769 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c96k6"] Jun 10 19:09:18.634358 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.634332 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.637066 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.637016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 10 19:09:18.637227 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.637179 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zsd9s\"" Jun 10 19:09:18.646732 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.646707 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c96k6"] Jun 10 19:09:18.652117 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.652085 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:18.735023 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.734938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.735023 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.734982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46gd7\" (UniqueName: \"kubernetes.io/projected/f8887a73-bbe0-4f30-9332-5a92efc9da36-kube-api-access-46gd7\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.836545 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.836505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.837030 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.836557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46gd7\" (UniqueName: \"kubernetes.io/projected/f8887a73-bbe0-4f30-9332-5a92efc9da36-kube-api-access-46gd7\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.837030 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:18.836712 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 10 19:09:18.837030 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:18.836806 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs podName:f8887a73-bbe0-4f30-9332-5a92efc9da36 nodeName:}" failed. No retries permitted until 2026-06-10 19:09:19.336781353 +0000 UTC m=+622.291746276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs") pod "model-serving-api-5dd488fc48-c96k6" (UID: "f8887a73-bbe0-4f30-9332-5a92efc9da36") : secret "model-serving-api-tls" not found Jun 10 19:09:18.849563 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.849537 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46gd7\" (UniqueName: \"kubernetes.io/projected/f8887a73-bbe0-4f30-9332-5a92efc9da36-kube-api-access-46gd7\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:18.910718 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.910684 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j"] Jun 10 19:09:18.913728 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.913703 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:18.916765 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.916740 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:09:18.916932 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.916751 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:09:18.916932 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.916909 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:09:18.930991 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:18.930927 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j"] Jun 10 19:09:19.038739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.038652 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.038739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.038701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.038739 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.038731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gh6x\" (UniqueName: \"kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.139544 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.139505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.139741 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.139568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.139741 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.139618 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gh6x\" (UniqueName: \"kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.140064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.140037 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.140192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.140177 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.156058 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.156021 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gh6x\" (UniqueName: \"kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.226293 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.226260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:19.342630 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.342519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:19.342804 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:19.342704 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 10 19:09:19.342804 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:09:19.342783 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs podName:f8887a73-bbe0-4f30-9332-5a92efc9da36 nodeName:}" failed. No retries permitted until 2026-06-10 19:09:20.342763492 +0000 UTC m=+623.297728426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs") pod "model-serving-api-5dd488fc48-c96k6" (UID: "f8887a73-bbe0-4f30-9332-5a92efc9da36") : secret "model-serving-api-tls" not found Jun 10 19:09:19.443641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.443599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:19.446632 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.446604 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf04193d-baa8-4a89-a605-5cafccff7ec5-cert\") pod \"odh-model-controller-6dc94f689f-p52bk\" (UID: \"bf04193d-baa8-4a89-a605-5cafccff7ec5\") " pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:19.592283 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:19.592027 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:20.067380 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.067238 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:20.073716 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.073689 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-p52bk"] Jun 10 19:09:20.076280 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:20.076256 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf04193d_baa8_4a89_a605_5cafccff7ec5.slice/crio-9de6f928e4ebcae4cebb059787acf6a3f85dd043706957aabe8234d4a010d88f WatchSource:0}: Error finding container 9de6f928e4ebcae4cebb059787acf6a3f85dd043706957aabe8234d4a010d88f: Status 404 returned error can't find the container with id 9de6f928e4ebcae4cebb059787acf6a3f85dd043706957aabe8234d4a010d88f Jun 10 19:09:20.095206 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.095180 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j"] Jun 10 19:09:20.097070 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:20.097026 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7369c25_1c2b_49b4_ba65_741c736b2a14.slice/crio-41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f WatchSource:0}: Error finding container 41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f: Status 404 returned error can't find the container with id 41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f Jun 10 19:09:20.354116 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.354011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:20.356873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.356844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8887a73-bbe0-4f30-9332-5a92efc9da36-tls-certs\") pod \"model-serving-api-5dd488fc48-c96k6\" (UID: \"f8887a73-bbe0-4f30-9332-5a92efc9da36\") " pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:20.448554 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.448516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:20.890507 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:20.890482 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-c96k6"] Jun 10 19:09:20.907459 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:20.907425 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8887a73_bbe0_4f30_9332_5a92efc9da36.slice/crio-b42ad0d681e58f4816590f3b1e645588b6190765c7bdb0366a8d25bd1330a195 WatchSource:0}: Error finding container b42ad0d681e58f4816590f3b1e645588b6190765c7bdb0366a8d25bd1330a195: Status 404 returned error can't find the container with id b42ad0d681e58f4816590f3b1e645588b6190765c7bdb0366a8d25bd1330a195 Jun 10 19:09:21.080478 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.080378 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" event={"ID":"561c9e55-05d6-476b-9203-c9c15e210c22","Type":"ContainerStarted","Data":"d56899d3dcad708d7e11b65bc67cc07e44d9002e3ce59ef276bb762f9841c8fb"} Jun 10 19:09:21.082001 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.081969 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" event={"ID":"f8887a73-bbe0-4f30-9332-5a92efc9da36","Type":"ContainerStarted","Data":"b42ad0d681e58f4816590f3b1e645588b6190765c7bdb0366a8d25bd1330a195"} Jun 10 19:09:21.084053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.084018 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerID="00b5741abdd3d73f2fa8fb16bfe70afc646b78916b4d5fb2d311888dcae6ac47" exitCode=0 Jun 10 19:09:21.084199 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.084109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" event={"ID":"e7369c25-1c2b-49b4-ba65-741c736b2a14","Type":"ContainerDied","Data":"00b5741abdd3d73f2fa8fb16bfe70afc646b78916b4d5fb2d311888dcae6ac47"} Jun 10 19:09:21.084199 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.084158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" event={"ID":"e7369c25-1c2b-49b4-ba65-741c736b2a14","Type":"ContainerStarted","Data":"41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f"} Jun 10 19:09:21.085816 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.085754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" event={"ID":"bf04193d-baa8-4a89-a605-5cafccff7ec5","Type":"ContainerStarted","Data":"9de6f928e4ebcae4cebb059787acf6a3f85dd043706957aabe8234d4a010d88f"} Jun 10 19:09:21.100939 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:21.100877 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-755b69b8fb-8pp5z" podStartSLOduration=1.051636457 podStartE2EDuration="4.10085511s" totalImagesPullingTime="3.049218653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:21.096723444 +0000 UTC m=+624.051688383" watchObservedRunningTime="2026-06-10 19:09:21.10085511 +0000 UTC m=+624.055820051" Jun 10 19:09:22.096312 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:22.096259 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerID="50ab1df4c512f05d7d4f129f4c5118c601293f0a6558a1f1365a1ba08de853c7" exitCode=0 Jun 10 19:09:22.096874 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:22.096482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" event={"ID":"e7369c25-1c2b-49b4-ba65-741c736b2a14","Type":"ContainerDied","Data":"50ab1df4c512f05d7d4f129f4c5118c601293f0a6558a1f1365a1ba08de853c7"} Jun 10 19:09:24.110884 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.110781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" event={"ID":"f8887a73-bbe0-4f30-9332-5a92efc9da36","Type":"ContainerStarted","Data":"e76ddcc6dc9cdd3830f7ecdcd39b777dbb2e552e9c205231124329a954f3ab3a"} Jun 10 19:09:24.111313 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.110953 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:24.112944 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.112918 2580 generic.go:356] "Generic (PLEG): container finished" podID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerID="8426f2f2c085b94624760a58dae15e1c74ef0c394fed3b1c309ecca3b5a631b5" exitCode=0 Jun 10 19:09:24.113072 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.112961 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" event={"ID":"e7369c25-1c2b-49b4-ba65-741c736b2a14","Type":"ContainerDied","Data":"8426f2f2c085b94624760a58dae15e1c74ef0c394fed3b1c309ecca3b5a631b5"} Jun 10 19:09:24.114299 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.114277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" event={"ID":"bf04193d-baa8-4a89-a605-5cafccff7ec5","Type":"ContainerStarted","Data":"e3f5d6d1e52a63d461cf6e8d05e7d4ef77e43dfdd66bd369c1346e092a534b5e"} Jun 10 19:09:24.114422 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.114409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:24.128068 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.128017 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" podStartSLOduration=3.5399121300000003 podStartE2EDuration="6.127997131s" totalImagesPullingTime="2.588085001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:24.127778278 +0000 UTC m=+627.082743208" watchObservedRunningTime="2026-06-10 19:09:24.127997131 +0000 UTC m=+627.082962071" Jun 10 19:09:24.147909 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:24.147855 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" podStartSLOduration=3.725722573 podStartE2EDuration="7.147840195s" totalImagesPullingTime="3.422117622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:24.145607678 +0000 UTC m=+627.100572619" watchObservedRunningTime="2026-06-10 19:09:24.147840195 +0000 UTC m=+627.102805205" Jun 10 19:09:25.255966 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.255941 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:25.403549 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.403520 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gh6x\" (UniqueName: \"kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x\") pod \"e7369c25-1c2b-49b4-ba65-741c736b2a14\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " Jun 10 19:09:25.403733 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.403573 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle\") pod \"e7369c25-1c2b-49b4-ba65-741c736b2a14\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " Jun 10 19:09:25.403733 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.403656 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util\") pod \"e7369c25-1c2b-49b4-ba65-741c736b2a14\" (UID: \"e7369c25-1c2b-49b4-ba65-741c736b2a14\") " Jun 10 19:09:25.404520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.404482 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle" (OuterVolumeSpecName: "bundle") pod "e7369c25-1c2b-49b4-ba65-741c736b2a14" (UID: "e7369c25-1c2b-49b4-ba65-741c736b2a14"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:09:25.405810 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.405771 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x" (OuterVolumeSpecName: "kube-api-access-6gh6x") pod "e7369c25-1c2b-49b4-ba65-741c736b2a14" (UID: "e7369c25-1c2b-49b4-ba65-741c736b2a14"). InnerVolumeSpecName "kube-api-access-6gh6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:09:25.409458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.409433 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util" (OuterVolumeSpecName: "util") pod "e7369c25-1c2b-49b4-ba65-741c736b2a14" (UID: "e7369c25-1c2b-49b4-ba65-741c736b2a14"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:09:25.504956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.504922 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:25.504956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.504949 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7369c25-1c2b-49b4-ba65-741c736b2a14-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:25.504956 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:25.504959 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gh6x\" (UniqueName: \"kubernetes.io/projected/e7369c25-1c2b-49b4-ba65-741c736b2a14-kube-api-access-6gh6x\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:26.127180 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:26.127148 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" Jun 10 19:09:26.127369 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:26.127156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab068bs9j" event={"ID":"e7369c25-1c2b-49b4-ba65-741c736b2a14","Type":"ContainerDied","Data":"41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f"} Jun 10 19:09:26.127369 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:26.127265 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41a44ad8a011e565cf4f7736b53b59b39304802436a6fe3ec23c3927d5ca305f" Jun 10 19:09:27.868630 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.868568 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:27.936388 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936355 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-b4knl"] Jun 10 19:09:27.936772 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936759 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="extract" Jun 10 19:09:27.936823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936773 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="extract" Jun 10 19:09:27.936823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936791 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="pull" Jun 10 19:09:27.936823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936797 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="pull" Jun 10 19:09:27.936823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936805 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="util" Jun 10 19:09:27.936823 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936811 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="util" Jun 10 19:09:27.936976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.936869 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7369c25-1c2b-49b4-ba65-741c736b2a14" containerName="extract" Jun 10 19:09:27.940286 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.940270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:27.943272 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.943249 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-62krm\"" Jun 10 19:09:27.944292 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.944277 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 19:09:27.949064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.949041 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827"] Jun 10 19:09:27.952636 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.952618 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:27.953164 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.953141 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-b4knl"] Jun 10 19:09:27.956107 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.956090 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 19:09:27.958096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.958074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7w2gr\"" Jun 10 19:09:27.969641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.969610 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827"] Jun 10 19:09:27.975596 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:27.975552 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:28.028259 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.028226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0f71c6-c76c-4463-9100-d79addd591e3-cert\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.028464 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.028333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg6sc\" (UniqueName: \"kubernetes.io/projected/4a0f71c6-c76c-4463-9100-d79addd591e3-kube-api-access-pg6sc\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.048257 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.048221 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:28.129282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.129196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285c8cf6-158c-444d-ade6-0809f65d0f61-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.129282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.129243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq7wh\" (UniqueName: \"kubernetes.io/projected/285c8cf6-158c-444d-ade6-0809f65d0f61-kube-api-access-pq7wh\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.129504 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.129332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg6sc\" (UniqueName: \"kubernetes.io/projected/4a0f71c6-c76c-4463-9100-d79addd591e3-kube-api-access-pg6sc\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.129504 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.129394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0f71c6-c76c-4463-9100-d79addd591e3-cert\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.132044 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.132013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a0f71c6-c76c-4463-9100-d79addd591e3-cert\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.154284 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.154260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg6sc\" (UniqueName: \"kubernetes.io/projected/4a0f71c6-c76c-4463-9100-d79addd591e3-kube-api-access-pg6sc\") pod \"kserve-controller-manager-69fc866d76-b4knl\" (UID: \"4a0f71c6-c76c-4463-9100-d79addd591e3\") " pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.224691 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.224654 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:28.230841 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.230800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285c8cf6-158c-444d-ade6-0809f65d0f61-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.230979 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.230861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq7wh\" (UniqueName: \"kubernetes.io/projected/285c8cf6-158c-444d-ade6-0809f65d0f61-kube-api-access-pq7wh\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.233398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.233378 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/285c8cf6-158c-444d-ade6-0809f65d0f61-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.251189 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.251159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:28.253017 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.252996 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq7wh\" (UniqueName: \"kubernetes.io/projected/285c8cf6-158c-444d-ade6-0809f65d0f61-kube-api-access-pq7wh\") pod \"llmisvc-controller-manager-864bfd7bc9-rt827\" (UID: \"285c8cf6-158c-444d-ade6-0809f65d0f61\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.262659 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.262637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:28.329550 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.329477 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:28.423607 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.422330 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-b4knl"] Jun 10 19:09:28.429635 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:28.429592 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a0f71c6_c76c_4463_9100_d79addd591e3.slice/crio-56b33c68cc476ad64ac66b8e586e1f5ef806e3fc118e34aff049cea82e8397fe WatchSource:0}: Error finding container 56b33c68cc476ad64ac66b8e586e1f5ef806e3fc118e34aff049cea82e8397fe: Status 404 returned error can't find the container with id 56b33c68cc476ad64ac66b8e586e1f5ef806e3fc118e34aff049cea82e8397fe Jun 10 19:09:28.448280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:28.448227 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827"] Jun 10 19:09:28.450373 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:28.450351 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod285c8cf6_158c_444d_ade6_0809f65d0f61.slice/crio-5beb1a0093b268bcbd82c89af1185ffe60fdb1af147f052e92a3e3592947bf37 WatchSource:0}: Error finding container 5beb1a0093b268bcbd82c89af1185ffe60fdb1af147f052e92a3e3592947bf37: Status 404 returned error can't find the container with id 5beb1a0093b268bcbd82c89af1185ffe60fdb1af147f052e92a3e3592947bf37 Jun 10 19:09:29.144963 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:29.144926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" event={"ID":"285c8cf6-158c-444d-ade6-0809f65d0f61","Type":"ContainerStarted","Data":"5beb1a0093b268bcbd82c89af1185ffe60fdb1af147f052e92a3e3592947bf37"} Jun 10 19:09:29.146217 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:29.146187 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" event={"ID":"4a0f71c6-c76c-4463-9100-d79addd591e3","Type":"ContainerStarted","Data":"56b33c68cc476ad64ac66b8e586e1f5ef806e3fc118e34aff049cea82e8397fe"} Jun 10 19:09:32.874198 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:32.874161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:33.079601 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.079540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:33.171086 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.171036 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" event={"ID":"4a0f71c6-c76c-4463-9100-d79addd591e3","Type":"ContainerStarted","Data":"12dc09ee840a6224ccceea27f32f575afed4846c2130007b9aa63c30267dbe62"} Jun 10 19:09:33.171298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.171241 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:09:33.172633 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.172609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" event={"ID":"285c8cf6-158c-444d-ade6-0809f65d0f61","Type":"ContainerStarted","Data":"db0c801ca737ef491ed36e03f6d166a1886de0a83bfdf5532de16b8e607c346c"} Jun 10 19:09:33.172765 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.172651 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:09:33.210523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.210470 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" podStartSLOduration=2.372425246 podStartE2EDuration="6.210457022s" totalImagesPullingTime="3.838031776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:33.207664923 +0000 UTC m=+636.162629861" watchObservedRunningTime="2026-06-10 19:09:33.210457022 +0000 UTC m=+636.165421960" Jun 10 19:09:33.239876 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:33.239822 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" podStartSLOduration=2.418585149 podStartE2EDuration="6.239802989s" totalImagesPullingTime="3.82121784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:33.23733826 +0000 UTC m=+636.192303200" watchObservedRunningTime="2026-06-10 19:09:33.239802989 +0000 UTC m=+636.194767927" Jun 10 19:09:34.241389 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.241345 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb"] Jun 10 19:09:34.245547 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.245526 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.255457 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.255433 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:09:34.255619 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.255489 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:09:34.256631 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.256615 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:09:34.265886 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.265862 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb"] Jun 10 19:09:34.389164 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.389129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.389360 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.389180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.389360 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.389239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qbd9\" (UniqueName: \"kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.489997 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.489957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.490215 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.490010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.490215 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.490031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qbd9\" (UniqueName: \"kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.490490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.490465 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.490490 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.490479 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.519195 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.519120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qbd9\" (UniqueName: \"kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.554976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.554939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:34.705924 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.705889 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:34.734344 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.734316 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb"] Jun 10 19:09:34.735983 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:34.735955 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfab02e_5c53_4d72_9eea_301f0939c3f9.slice/crio-0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c WatchSource:0}: Error finding container 0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c: Status 404 returned error can't find the container with id 0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c Jun 10 19:09:34.864096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:34.864060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:35.014409 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.014362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:35.122836 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.122736 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-p52bk" Jun 10 19:09:35.125046 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.125021 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-c96k6" Jun 10 19:09:35.158103 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.158042 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:35.187467 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.187433 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerID="9ee3cc5610af111d0e32a1947111c33b406717401b111aa58c25116f4509e26c" exitCode=0 Jun 10 19:09:35.187683 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.187516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" event={"ID":"2bfab02e-5c53-4d72-9eea-301f0939c3f9","Type":"ContainerDied","Data":"9ee3cc5610af111d0e32a1947111c33b406717401b111aa58c25116f4509e26c"} Jun 10 19:09:35.187683 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.187595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" event={"ID":"2bfab02e-5c53-4d72-9eea-301f0939c3f9","Type":"ContainerStarted","Data":"0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c"} Jun 10 19:09:35.188701 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.188685 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:09:35.530520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:35.530490 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:36.194797 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.194765 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerID="bc9c4ec42f6f4abbdb59a6f1a13b49c0b36c42efe3bad8db4d6460f76324d600" exitCode=0 Jun 10 19:09:36.194952 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.194817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" event={"ID":"2bfab02e-5c53-4d72-9eea-301f0939c3f9","Type":"ContainerDied","Data":"bc9c4ec42f6f4abbdb59a6f1a13b49c0b36c42efe3bad8db4d6460f76324d600"} Jun 10 19:09:36.667936 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.667901 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j44s2"] Jun 10 19:09:36.671497 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.671479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.675111 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.675088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 19:09:36.688559 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.688530 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-f29f8\"" Jun 10 19:09:36.689983 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.689961 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 19:09:36.709351 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.709323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf467ab3-82a9-4277-abb4-d14e47b81dcc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.709476 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.709358 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq56m\" (UniqueName: \"kubernetes.io/projected/cf467ab3-82a9-4277-abb4-d14e47b81dcc-kube-api-access-wq56m\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.729315 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.729225 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j44s2"] Jun 10 19:09:36.810749 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.810706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf467ab3-82a9-4277-abb4-d14e47b81dcc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.810749 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.810753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq56m\" (UniqueName: \"kubernetes.io/projected/cf467ab3-82a9-4277-abb4-d14e47b81dcc-kube-api-access-wq56m\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.813344 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.813324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf467ab3-82a9-4277-abb4-d14e47b81dcc-operator-config\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.821612 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.821569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq56m\" (UniqueName: \"kubernetes.io/projected/cf467ab3-82a9-4277-abb4-d14e47b81dcc-kube-api-access-wq56m\") pod \"servicemesh-operator3-57f65f65fb-j44s2\" (UID: \"cf467ab3-82a9-4277-abb4-d14e47b81dcc\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:36.981288 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:36.981185 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:37.149846 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:37.149804 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-j44s2"] Jun 10 19:09:37.149978 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:37.149867 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf467ab3_82a9_4277_abb4_d14e47b81dcc.slice/crio-ee2950651029be9a6a498b3a1c74c0763f4f745323f35832a4a5116d678046d0 WatchSource:0}: Error finding container ee2950651029be9a6a498b3a1c74c0763f4f745323f35832a4a5116d678046d0: Status 404 returned error can't find the container with id ee2950651029be9a6a498b3a1c74c0763f4f745323f35832a4a5116d678046d0 Jun 10 19:09:37.202154 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:37.202122 2580 generic.go:356] "Generic (PLEG): container finished" podID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerID="4b9af05a1569f0a78b829e585be3b62ca3455c2460d00c70383701364caedbbb" exitCode=0 Jun 10 19:09:37.202345 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:37.202207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" event={"ID":"2bfab02e-5c53-4d72-9eea-301f0939c3f9","Type":"ContainerDied","Data":"4b9af05a1569f0a78b829e585be3b62ca3455c2460d00c70383701364caedbbb"} Jun 10 19:09:37.203867 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:37.203839 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" event={"ID":"cf467ab3-82a9-4277-abb4-d14e47b81dcc","Type":"ContainerStarted","Data":"ee2950651029be9a6a498b3a1c74c0763f4f745323f35832a4a5116d678046d0"} Jun 10 19:09:38.345050 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.345020 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:38.425765 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.425731 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle\") pod \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " Jun 10 19:09:38.425943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.425784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util\") pod \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " Jun 10 19:09:38.425943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.425811 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qbd9\" (UniqueName: \"kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9\") pod \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\" (UID: \"2bfab02e-5c53-4d72-9eea-301f0939c3f9\") " Jun 10 19:09:38.426896 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.426864 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle" (OuterVolumeSpecName: "bundle") pod "2bfab02e-5c53-4d72-9eea-301f0939c3f9" (UID: "2bfab02e-5c53-4d72-9eea-301f0939c3f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:09:38.428226 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.428197 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9" (OuterVolumeSpecName: "kube-api-access-7qbd9") pod "2bfab02e-5c53-4d72-9eea-301f0939c3f9" (UID: "2bfab02e-5c53-4d72-9eea-301f0939c3f9"). InnerVolumeSpecName "kube-api-access-7qbd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:09:38.433810 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.433782 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util" (OuterVolumeSpecName: "util") pod "2bfab02e-5c53-4d72-9eea-301f0939c3f9" (UID: "2bfab02e-5c53-4d72-9eea-301f0939c3f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:09:38.527204 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.527111 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:38.527204 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.527143 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bfab02e-5c53-4d72-9eea-301f0939c3f9-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:38.527204 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:38.527157 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qbd9\" (UniqueName: \"kubernetes.io/projected/2bfab02e-5c53-4d72-9eea-301f0939c3f9-kube-api-access-7qbd9\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:09:39.024070 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024037 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-755b4c8f6c-7j25j"] Jun 10 19:09:39.024454 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024442 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="util" Jun 10 19:09:39.024503 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024456 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="util" Jun 10 19:09:39.024503 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024464 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="pull" Jun 10 19:09:39.024503 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024470 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="pull" Jun 10 19:09:39.024503 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024489 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="extract" Jun 10 19:09:39.024503 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024496 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="extract" Jun 10 19:09:39.024719 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.024559 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfab02e-5c53-4d72-9eea-301f0939c3f9" containerName="extract" Jun 10 19:09:39.027728 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.027701 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.039970 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.039947 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b4c8f6c-7j25j"] Jun 10 19:09:39.092947 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.092909 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:39.133295 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-oauth-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-trusted-ca-bundle\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133409 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-service-ca\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xcf\" (UniqueName: \"kubernetes.io/projected/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-kube-api-access-k6xcf\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-oauth-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.133696 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.133612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.188811 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.188769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:39.218246 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.218206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" event={"ID":"2bfab02e-5c53-4d72-9eea-301f0939c3f9","Type":"ContainerDied","Data":"0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c"} Jun 10 19:09:39.218420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.218304 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ba97baa2877bd0fc67905fca64a34cc836040bc2a64aab938e7ee9452cb466c" Jun 10 19:09:39.218420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.218218 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ar6zxb" Jun 10 19:09:39.234667 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234637 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.234800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-oauth-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.234800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.234800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-oauth-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.234800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-trusted-ca-bundle\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235022 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-service-ca\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235022 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.234853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xcf\" (UniqueName: \"kubernetes.io/projected/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-kube-api-access-k6xcf\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.235480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-oauth-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.235490 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.235556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-service-ca\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.235710 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.235679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-trusted-ca-bundle\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.237272 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.237242 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-oauth-config\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.237272 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.237255 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-console-serving-cert\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.243609 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.243573 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xcf\" (UniqueName: \"kubernetes.io/projected/6cc617d4-29c4-4ce9-9194-87bc5b575d5f-kube-api-access-k6xcf\") pod \"console-755b4c8f6c-7j25j\" (UID: \"6cc617d4-29c4-4ce9-9194-87bc5b575d5f\") " pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.338452 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.338356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:39.498688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:39.498659 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-755b4c8f6c-7j25j"] Jun 10 19:09:39.500170 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:39.500141 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc617d4_29c4_4ce9_9194_87bc5b575d5f.slice/crio-aab788a34ab26a9ca123a954a8b842f3815c52fe438c546e3ed07e7144108181 WatchSource:0}: Error finding container aab788a34ab26a9ca123a954a8b842f3815c52fe438c546e3ed07e7144108181: Status 404 returned error can't find the container with id aab788a34ab26a9ca123a954a8b842f3815c52fe438c546e3ed07e7144108181 Jun 10 19:09:40.225978 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:40.225939 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b4c8f6c-7j25j" event={"ID":"6cc617d4-29c4-4ce9-9194-87bc5b575d5f","Type":"ContainerStarted","Data":"aab788a34ab26a9ca123a954a8b842f3815c52fe438c546e3ed07e7144108181"} Jun 10 19:09:41.234018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:41.233981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" event={"ID":"cf467ab3-82a9-4277-abb4-d14e47b81dcc","Type":"ContainerStarted","Data":"1c1958521cc9c1fcc3379415381859974a4e50bc1c858e2654fef0558dac3fd5"} Jun 10 19:09:41.234437 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:41.234121 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:41.235773 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:41.235752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-755b4c8f6c-7j25j" event={"ID":"6cc617d4-29c4-4ce9-9194-87bc5b575d5f","Type":"ContainerStarted","Data":"259432f2cd24067e442d68b86bbb181dc563f2e3c2838393a9f03721e507d032"} Jun 10 19:09:41.258411 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:41.258362 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" podStartSLOduration=1.9170495889999999 podStartE2EDuration="5.258346541s" totalImagesPullingTime="3.341296952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:41.255798523 +0000 UTC m=+644.210763548" watchObservedRunningTime="2026-06-10 19:09:41.258346541 +0000 UTC m=+644.213311477" Jun 10 19:09:41.279685 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:41.279629 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-755b4c8f6c-7j25j" podStartSLOduration=2.279614161 podStartE2EDuration="2.279614161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:41.277653688 +0000 UTC m=+644.232618628" watchObservedRunningTime="2026-06-10 19:09:41.279614161 +0000 UTC m=+644.234579100" Jun 10 19:09:47.557192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.557157 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-vgs9q"] Jun 10 19:09:47.560574 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.560555 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.566652 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.566628 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xgxb8\"" Jun 10 19:09:47.566652 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.566648 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 19:09:47.574338 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.574311 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-vgs9q"] Jun 10 19:09:47.617556 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.617522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/398a2933-c62e-49f6-b71b-0bbdfad78355-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.617779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.617609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-295n7\" (UniqueName: \"kubernetes.io/projected/398a2933-c62e-49f6-b71b-0bbdfad78355-kube-api-access-295n7\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.638829 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.638791 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:47.718393 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.718354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-295n7\" (UniqueName: \"kubernetes.io/projected/398a2933-c62e-49f6-b71b-0bbdfad78355-kube-api-access-295n7\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.718576 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.718446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/398a2933-c62e-49f6-b71b-0bbdfad78355-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.719173 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.719152 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/398a2933-c62e-49f6-b71b-0bbdfad78355-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.727494 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.727472 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-295n7\" (UniqueName: \"kubernetes.io/projected/398a2933-c62e-49f6-b71b-0bbdfad78355-kube-api-access-295n7\") pod \"dashboard-redirect-66f6b98bc9-vgs9q\" (UID: \"398a2933-c62e-49f6-b71b-0bbdfad78355\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:47.872111 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:47.872008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" Jun 10 19:09:48.012981 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:48.012956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-vgs9q"] Jun 10 19:09:48.014507 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:09:48.014476 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398a2933_c62e_49f6_b71b_0bbdfad78355.slice/crio-893549d9cbabd187d8f50e84a271fac075e76e120eeaa01e184bdc33e0ae95ac WatchSource:0}: Error finding container 893549d9cbabd187d8f50e84a271fac075e76e120eeaa01e184bdc33e0ae95ac: Status 404 returned error can't find the container with id 893549d9cbabd187d8f50e84a271fac075e76e120eeaa01e184bdc33e0ae95ac Jun 10 19:09:48.274138 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:48.274101 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" event={"ID":"398a2933-c62e-49f6-b71b-0bbdfad78355","Type":"ContainerStarted","Data":"893549d9cbabd187d8f50e84a271fac075e76e120eeaa01e184bdc33e0ae95ac"} Jun 10 19:09:49.338908 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:49.338861 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:49.339390 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:49.338968 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:49.345709 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:49.345677 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:50.292626 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:50.292587 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-755b4c8f6c-7j25j" Jun 10 19:09:50.359394 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:50.359360 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:09:50.509572 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:50.509531 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:50.606852 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:50.606760 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:50.705538 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:50.705495 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:09:52.243861 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:52.243831 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-j44s2" Jun 10 19:09:53.306922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:53.306881 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" event={"ID":"398a2933-c62e-49f6-b71b-0bbdfad78355","Type":"ContainerStarted","Data":"24b20fe6681943da5e452130adca6c87eefa55b8c04830dadc1f79b8e60b3ce7"} Jun 10 19:09:53.332341 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:09:53.332234 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-66f6b98bc9-vgs9q" podStartSLOduration=1.268157117 podStartE2EDuration="6.332217449s" totalImagesPullingTime="5.064060332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:53.327789363 +0000 UTC m=+656.282754302" watchObservedRunningTime="2026-06-10 19:09:53.332217449 +0000 UTC m=+656.287182389" Jun 10 19:10:01.905028 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.904989 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs"] Jun 10 19:10:01.913347 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.913322 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:01.916526 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.916502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 19:10:01.916526 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.916514 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 19:10:01.916756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.916502 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 19:10:01.916756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.916518 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5cjpx\"" Jun 10 19:10:01.916756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.916500 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 19:10:01.922549 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.922524 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:01.924784 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:01.924748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs"] Jun 10 19:10:02.019368 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.019332 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:02.050706 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.050900 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.050900 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26227384-2bcb-4150-b6c6-da47e9003614-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.050900 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050859 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.051076 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050918 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rss6f\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-kube-api-access-rss6f\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.051076 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.050966 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.051076 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.051035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152439 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rss6f\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-kube-api-access-rss6f\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152439 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152729 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152729 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152729 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152729 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26227384-2bcb-4150-b6c6-da47e9003614-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.152937 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.152828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.153199 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.153173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.155306 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.155246 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.155306 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.155285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.155473 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.155372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/26227384-2bcb-4150-b6c6-da47e9003614-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.155521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.155498 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/26227384-2bcb-4150-b6c6-da47e9003614-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.161379 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.161356 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rss6f\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-kube-api-access-rss6f\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.161470 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.161382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26227384-2bcb-4150-b6c6-da47e9003614-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zq9hs\" (UID: \"26227384-2bcb-4150-b6c6-da47e9003614\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.223844 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.223811 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:02.372704 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.372669 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs"] Jun 10 19:10:02.373381 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:02.373342 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26227384_2bcb_4150_b6c6_da47e9003614.slice/crio-aa2af622f3e2e91f7a226af61c27b6eeba7696fe175920db640ec61477747506 WatchSource:0}: Error finding container aa2af622f3e2e91f7a226af61c27b6eeba7696fe175920db640ec61477747506: Status 404 returned error can't find the container with id aa2af622f3e2e91f7a226af61c27b6eeba7696fe175920db640ec61477747506 Jun 10 19:10:02.481086 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:02.480973 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:03.364348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:03.364310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" event={"ID":"26227384-2bcb-4150-b6c6-da47e9003614","Type":"ContainerStarted","Data":"aa2af622f3e2e91f7a226af61c27b6eeba7696fe175920db640ec61477747506"} Jun 10 19:10:04.181409 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:04.181373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rt827" Jun 10 19:10:04.185892 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:04.185861 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-b4knl" Jun 10 19:10:05.510351 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:05.510276 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 19:10:05.510644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:05.510389 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 19:10:06.385833 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.385776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" event={"ID":"26227384-2bcb-4150-b6c6-da47e9003614","Type":"ContainerStarted","Data":"b8b4ac35d2fd3e64d27b8bd3314ffc16c5cd38670141723578a5a4defff48a7f"} Jun 10 19:10:06.386041 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.385849 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:06.387840 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.387813 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-zq9hs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 19:10:06.387962 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.387860 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" podUID="26227384-2bcb-4150-b6c6-da47e9003614" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:10:06.409020 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.408970 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" podStartSLOduration=2.274527894 podStartE2EDuration="5.408953925s" totalImagesPullingTime="3.134426031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:10:06.40591001 +0000 UTC m=+669.360874953" watchObservedRunningTime="2026-06-10 19:10:06.408953925 +0000 UTC m=+669.363918864" Jun 10 19:10:06.638348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.638242 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:06.738330 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.738291 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:06.941473 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:06.941434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:07.083491 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:07.083456 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:07.187458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:07.187424 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:07.392619 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:07.392518 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zq9hs" Jun 10 19:10:07.589872 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:07.589840 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:15.386777 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.386705 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b6b4654bd-mf7kx" podUID="96d3a584-e040-4801-8dd0-a94c3949a7ea" containerName="console" containerID="cri-o://aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118" gracePeriod=15 Jun 10 19:10:15.643460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.643393 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:10:15.689557 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689523 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689557 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689559 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689611 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689634 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689759 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689985 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689895 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689985 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689921 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46wfg\" (UniqueName: \"kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg\") pod \"96d3a584-e040-4801-8dd0-a94c3949a7ea\" (UID: \"96d3a584-e040-4801-8dd0-a94c3949a7ea\") " Jun 10 19:10:15.689985 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.689957 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca" (OuterVolumeSpecName: "service-ca") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:10:15.690147 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690047 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config" (OuterVolumeSpecName: "console-config") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:10:15.690216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690138 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:10:15.690318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690293 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-service-ca\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.690318 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690317 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.690499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690323 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:10:15.690499 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.690331 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-trusted-ca-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.691898 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.691872 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:10:15.692048 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.692027 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:10:15.692216 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.692192 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg" (OuterVolumeSpecName: "kube-api-access-46wfg") pod "96d3a584-e040-4801-8dd0-a94c3949a7ea" (UID: "96d3a584-e040-4801-8dd0-a94c3949a7ea"). InnerVolumeSpecName "kube-api-access-46wfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:10:15.791269 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.791231 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96d3a584-e040-4801-8dd0-a94c3949a7ea-oauth-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.791269 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.791262 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46wfg\" (UniqueName: \"kubernetes.io/projected/96d3a584-e040-4801-8dd0-a94c3949a7ea-kube-api-access-46wfg\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.791269 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.791273 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-serving-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:15.791516 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:15.791282 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96d3a584-e040-4801-8dd0-a94c3949a7ea-console-oauth-config\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:16.451460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.451417 2580 generic.go:356] "Generic (PLEG): container finished" podID="96d3a584-e040-4801-8dd0-a94c3949a7ea" containerID="aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118" exitCode=0 Jun 10 19:10:16.451460 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.451467 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b6b4654bd-mf7kx" Jun 10 19:10:16.452014 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.451505 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4654bd-mf7kx" event={"ID":"96d3a584-e040-4801-8dd0-a94c3949a7ea","Type":"ContainerDied","Data":"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118"} Jun 10 19:10:16.452014 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.451574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b6b4654bd-mf7kx" event={"ID":"96d3a584-e040-4801-8dd0-a94c3949a7ea","Type":"ContainerDied","Data":"c118ead3ccb8184f6c79ec3b4192d39b518309e0d105c623bc7ad4b95a75c3d8"} Jun 10 19:10:16.452014 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.451623 2580 scope.go:117] "RemoveContainer" containerID="aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118" Jun 10 19:10:16.461770 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.461751 2580 scope.go:117] "RemoveContainer" containerID="aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118" Jun 10 19:10:16.462041 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:10:16.462020 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118\": container with ID starting with aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118 not found: ID does not exist" containerID="aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118" Jun 10 19:10:16.462117 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.462050 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118"} err="failed to get container status \"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118\": rpc error: code = NotFound desc = could not find container \"aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118\": container with ID starting with aa4307a136627b152729af6b7dfa3b62dfc06997b01258baaaedc26f62af3118 not found: ID does not exist" Jun 10 19:10:16.474707 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.474678 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:10:16.478067 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.478045 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b6b4654bd-mf7kx"] Jun 10 19:10:16.786860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.786756 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:16.887020 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:16.886985 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:17.487358 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:17.487323 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d3a584-e040-4801-8dd0-a94c3949a7ea" path="/var/lib/kubelet/pods/96d3a584-e040-4801-8dd0-a94c3949a7ea/volumes" Jun 10 19:10:18.266284 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:18.266248 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:18.370629 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:18.370598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:18.481531 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:18.481492 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:25.712298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:25.712265 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:32.817354 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.817314 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds"] Jun 10 19:10:32.817860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.817752 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d3a584-e040-4801-8dd0-a94c3949a7ea" containerName="console" Jun 10 19:10:32.817860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.817764 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d3a584-e040-4801-8dd0-a94c3949a7ea" containerName="console" Jun 10 19:10:32.817860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.817835 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d3a584-e040-4801-8dd0-a94c3949a7ea" containerName="console" Jun 10 19:10:32.837324 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.837295 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds"] Jun 10 19:10:32.837485 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.837397 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:32.840370 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.840330 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 19:10:32.840530 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.840379 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 19:10:32.840530 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.840469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vbxfk\"" Jun 10 19:10:32.948930 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.948887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:32.949162 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.948978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:32.949162 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:32.949051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm26c\" (UniqueName: \"kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.050484 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.050440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm26c\" (UniqueName: \"kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.050672 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.050522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.050672 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.050575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.050917 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.050896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.050957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.050928 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.060074 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.060047 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm26c\" (UniqueName: \"kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.148042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.147939 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:33.203826 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.203794 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6"] Jun 10 19:10:33.207713 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.207690 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.219359 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.219333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6"] Jun 10 19:10:33.252221 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.252189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.252371 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.252295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.252371 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.252332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd8xs\" (UniqueName: \"kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.292442 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.292416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds"] Jun 10 19:10:33.294123 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:33.294094 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11622bfb_597e_4f07_8034_b6e82f13d377.slice/crio-0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231 WatchSource:0}: Error finding container 0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231: Status 404 returned error can't find the container with id 0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231 Jun 10 19:10:33.353521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.353388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.353521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.353461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.353521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.353488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd8xs\" (UniqueName: \"kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.353830 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.353793 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.353925 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.353850 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.362265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.362246 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd8xs\" (UniqueName: \"kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.526138 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.526101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:33.551730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.551697 2580 generic.go:356] "Generic (PLEG): container finished" podID="11622bfb-597e-4f07-8034-b6e82f13d377" containerID="7a27c0510c16bc2d618d53e96f2afd46d11a1a9bfd1fd06592852749f92b8615" exitCode=0 Jun 10 19:10:33.551880 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.551784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" event={"ID":"11622bfb-597e-4f07-8034-b6e82f13d377","Type":"ContainerDied","Data":"7a27c0510c16bc2d618d53e96f2afd46d11a1a9bfd1fd06592852749f92b8615"} Jun 10 19:10:33.551880 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.551836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" event={"ID":"11622bfb-597e-4f07-8034-b6e82f13d377","Type":"ContainerStarted","Data":"0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231"} Jun 10 19:10:33.641427 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.641392 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk"] Jun 10 19:10:33.645081 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.645055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.658024 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.658001 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk"] Jun 10 19:10:33.669817 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.669796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6"] Jun 10 19:10:33.671918 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:33.671890 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd95606_e3ca_4dd0_b331_6c172d3ab6e8.slice/crio-a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811 WatchSource:0}: Error finding container a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811: Status 404 returned error can't find the container with id a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811 Jun 10 19:10:33.757883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.757831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.757883 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.757880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27lmn\" (UniqueName: \"kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.758184 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.757979 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.858972 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.858935 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.858972 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.858976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27lmn\" (UniqueName: \"kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.859406 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.859038 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.859444 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.859425 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.859479 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.859443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.868399 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.868372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27lmn\" (UniqueName: \"kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:33.958767 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:33.958660 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:34.007757 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.007724 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2"] Jun 10 19:10:34.011915 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.011883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.022459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.021571 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2"] Jun 10 19:10:34.061388 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.061356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.061601 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.061464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.061601 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.061517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd2xg\" (UniqueName: \"kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.104948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.104924 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk"] Jun 10 19:10:34.107617 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:34.107569 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8136fa1f_fd5b_4cdc_8060_8f27cb301645.slice/crio-7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0 WatchSource:0}: Error finding container 7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0: Status 404 returned error can't find the container with id 7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0 Jun 10 19:10:34.162164 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.162136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.162312 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.162206 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd2xg\" (UniqueName: \"kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.162312 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.162275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.162480 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.162460 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.162641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.162625 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.172025 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.172004 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd2xg\" (UniqueName: \"kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.327548 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.327506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:34.475217 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.475192 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2"] Jun 10 19:10:34.476626 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:34.476601 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc466b3e4_a460_4857_b3aa_310c89de020e.slice/crio-72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e WatchSource:0}: Error finding container 72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e: Status 404 returned error can't find the container with id 72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e Jun 10 19:10:34.559539 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.559507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" event={"ID":"c466b3e4-a460-4857-b3aa-310c89de020e","Type":"ContainerStarted","Data":"72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e"} Jun 10 19:10:34.561482 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.561455 2580 generic.go:356] "Generic (PLEG): container finished" podID="11622bfb-597e-4f07-8034-b6e82f13d377" containerID="ba90f7a5ec4cfeaaddd27388d09a587fb38a3313193e9498534e02048cbf14c9" exitCode=0 Jun 10 19:10:34.561619 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.561534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" event={"ID":"11622bfb-597e-4f07-8034-b6e82f13d377","Type":"ContainerDied","Data":"ba90f7a5ec4cfeaaddd27388d09a587fb38a3313193e9498534e02048cbf14c9"} Jun 10 19:10:34.562963 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.562940 2580 generic.go:356] "Generic (PLEG): container finished" podID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerID="2062ba4e6865bfd5bfe4cc12cd3980efd299e505e2aa8e7aa6ef88dfd920ba9f" exitCode=0 Jun 10 19:10:34.563070 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.563008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" event={"ID":"8136fa1f-fd5b-4cdc-8060-8f27cb301645","Type":"ContainerDied","Data":"2062ba4e6865bfd5bfe4cc12cd3980efd299e505e2aa8e7aa6ef88dfd920ba9f"} Jun 10 19:10:34.563070 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.563041 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" event={"ID":"8136fa1f-fd5b-4cdc-8060-8f27cb301645","Type":"ContainerStarted","Data":"7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0"} Jun 10 19:10:34.564871 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.564852 2580 generic.go:356] "Generic (PLEG): container finished" podID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerID="bb329aecea2fe58f8031c3914d46cbbe62df8fbc46e5d675561598f3f08fa1da" exitCode=0 Jun 10 19:10:34.564949 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.564908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" event={"ID":"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8","Type":"ContainerDied","Data":"bb329aecea2fe58f8031c3914d46cbbe62df8fbc46e5d675561598f3f08fa1da"} Jun 10 19:10:34.564949 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:34.564936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" event={"ID":"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8","Type":"ContainerStarted","Data":"a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811"} Jun 10 19:10:35.579820 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.579785 2580 generic.go:356] "Generic (PLEG): container finished" podID="11622bfb-597e-4f07-8034-b6e82f13d377" containerID="a404ba250fc9ce03cb5cc32c803b1e4452ac91188058155ee4d62d6eeffb50d9" exitCode=0 Jun 10 19:10:35.580240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.579859 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" event={"ID":"11622bfb-597e-4f07-8034-b6e82f13d377","Type":"ContainerDied","Data":"a404ba250fc9ce03cb5cc32c803b1e4452ac91188058155ee4d62d6eeffb50d9"} Jun 10 19:10:35.581574 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.581553 2580 generic.go:356] "Generic (PLEG): container finished" podID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerID="d7f12b633f6f567540fa2b3a7edef3cc1641bf4f22d2050656e6f3e077f81b85" exitCode=0 Jun 10 19:10:35.581720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.581611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" event={"ID":"8136fa1f-fd5b-4cdc-8060-8f27cb301645","Type":"ContainerDied","Data":"d7f12b633f6f567540fa2b3a7edef3cc1641bf4f22d2050656e6f3e077f81b85"} Jun 10 19:10:35.583729 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.583696 2580 generic.go:356] "Generic (PLEG): container finished" podID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerID="5cf0b1f5e50b6af7fd3c552861eb84127587458d8926b49d45630bf5e9acb7b4" exitCode=0 Jun 10 19:10:35.583817 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.583750 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" event={"ID":"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8","Type":"ContainerDied","Data":"5cf0b1f5e50b6af7fd3c552861eb84127587458d8926b49d45630bf5e9acb7b4"} Jun 10 19:10:35.585535 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.585514 2580 generic.go:356] "Generic (PLEG): container finished" podID="c466b3e4-a460-4857-b3aa-310c89de020e" containerID="e545ceeacf715fbc3f1f520799e4b2e2edb4501e73bf734bcb2fb281347c377b" exitCode=0 Jun 10 19:10:35.585656 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:35.585610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" event={"ID":"c466b3e4-a460-4857-b3aa-310c89de020e","Type":"ContainerDied","Data":"e545ceeacf715fbc3f1f520799e4b2e2edb4501e73bf734bcb2fb281347c377b"} Jun 10 19:10:36.593632 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.593598 2580 generic.go:356] "Generic (PLEG): container finished" podID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerID="821ba16fe5124ab1ddc8ce2c8e8b783e9af222ce9d8a2006c5b04e542f0d5d3d" exitCode=0 Jun 10 19:10:36.594082 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.593675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" event={"ID":"8136fa1f-fd5b-4cdc-8060-8f27cb301645","Type":"ContainerDied","Data":"821ba16fe5124ab1ddc8ce2c8e8b783e9af222ce9d8a2006c5b04e542f0d5d3d"} Jun 10 19:10:36.595721 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.595700 2580 generic.go:356] "Generic (PLEG): container finished" podID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerID="1f62b17c9c9c732341f53cba831962b99c95e6fe4401b1d72b400c16aedc315d" exitCode=0 Jun 10 19:10:36.595857 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.595817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" event={"ID":"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8","Type":"ContainerDied","Data":"1f62b17c9c9c732341f53cba831962b99c95e6fe4401b1d72b400c16aedc315d"} Jun 10 19:10:36.597482 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.597463 2580 generic.go:356] "Generic (PLEG): container finished" podID="c466b3e4-a460-4857-b3aa-310c89de020e" containerID="b476fc7a194e14b1810995b3c4a3123fa20227e92d994c116ae395d3c54343bd" exitCode=0 Jun 10 19:10:36.597603 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.597483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" event={"ID":"c466b3e4-a460-4857-b3aa-310c89de020e","Type":"ContainerDied","Data":"b476fc7a194e14b1810995b3c4a3123fa20227e92d994c116ae395d3c54343bd"} Jun 10 19:10:36.758547 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.758511 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:36.891671 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.891631 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm26c\" (UniqueName: \"kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c\") pod \"11622bfb-597e-4f07-8034-b6e82f13d377\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " Jun 10 19:10:36.891671 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.891676 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util\") pod \"11622bfb-597e-4f07-8034-b6e82f13d377\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " Jun 10 19:10:36.891931 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.891740 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle\") pod \"11622bfb-597e-4f07-8034-b6e82f13d377\" (UID: \"11622bfb-597e-4f07-8034-b6e82f13d377\") " Jun 10 19:10:36.892337 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.892304 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle" (OuterVolumeSpecName: "bundle") pod "11622bfb-597e-4f07-8034-b6e82f13d377" (UID: "11622bfb-597e-4f07-8034-b6e82f13d377"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:36.893957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.893927 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c" (OuterVolumeSpecName: "kube-api-access-jm26c") pod "11622bfb-597e-4f07-8034-b6e82f13d377" (UID: "11622bfb-597e-4f07-8034-b6e82f13d377"). InnerVolumeSpecName "kube-api-access-jm26c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:10:36.897222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.897183 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util" (OuterVolumeSpecName: "util") pod "11622bfb-597e-4f07-8034-b6e82f13d377" (UID: "11622bfb-597e-4f07-8034-b6e82f13d377"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:36.992836 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.992746 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm26c\" (UniqueName: \"kubernetes.io/projected/11622bfb-597e-4f07-8034-b6e82f13d377-kube-api-access-jm26c\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:36.992836 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.992778 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:36.992836 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:36.992791 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11622bfb-597e-4f07-8034-b6e82f13d377-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:37.605380 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.605346 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" Jun 10 19:10:37.605380 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.605365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds" event={"ID":"11622bfb-597e-4f07-8034-b6e82f13d377","Type":"ContainerDied","Data":"0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231"} Jun 10 19:10:37.605902 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.605425 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0683c2b9ae265880250d99deda23316616ee59fbf71eb55c1de0e63da91a4231" Jun 10 19:10:37.607665 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.607637 2580 generic.go:356] "Generic (PLEG): container finished" podID="c466b3e4-a460-4857-b3aa-310c89de020e" containerID="8e31f2d29db3e12c6a7ce69625490655f4f776a1f94dd0940889664e4d04f497" exitCode=0 Jun 10 19:10:37.607810 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.607701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" event={"ID":"c466b3e4-a460-4857-b3aa-310c89de020e","Type":"ContainerDied","Data":"8e31f2d29db3e12c6a7ce69625490655f4f776a1f94dd0940889664e4d04f497"} Jun 10 19:10:37.757486 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.757410 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:37.791315 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.791289 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:37.900920 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.900886 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd8xs\" (UniqueName: \"kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs\") pod \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " Jun 10 19:10:37.901077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.900938 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27lmn\" (UniqueName: \"kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn\") pod \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " Jun 10 19:10:37.901077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.900977 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle\") pod \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " Jun 10 19:10:37.901077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.901010 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util\") pod \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\" (UID: \"8136fa1f-fd5b-4cdc-8060-8f27cb301645\") " Jun 10 19:10:37.901077 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.901072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util\") pod \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " Jun 10 19:10:37.901303 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.901099 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle\") pod \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\" (UID: \"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8\") " Jun 10 19:10:37.901697 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.901542 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle" (OuterVolumeSpecName: "bundle") pod "8136fa1f-fd5b-4cdc-8060-8f27cb301645" (UID: "8136fa1f-fd5b-4cdc-8060-8f27cb301645"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:37.901785 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.901762 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle" (OuterVolumeSpecName: "bundle") pod "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" (UID: "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:37.903222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.903199 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn" (OuterVolumeSpecName: "kube-api-access-27lmn") pod "8136fa1f-fd5b-4cdc-8060-8f27cb301645" (UID: "8136fa1f-fd5b-4cdc-8060-8f27cb301645"). InnerVolumeSpecName "kube-api-access-27lmn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:10:37.903222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.903214 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs" (OuterVolumeSpecName: "kube-api-access-dd8xs") pod "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" (UID: "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8"). InnerVolumeSpecName "kube-api-access-dd8xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:10:37.906687 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.906654 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util" (OuterVolumeSpecName: "util") pod "8136fa1f-fd5b-4cdc-8060-8f27cb301645" (UID: "8136fa1f-fd5b-4cdc-8060-8f27cb301645"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:37.906874 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:37.906857 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util" (OuterVolumeSpecName: "util") pod "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" (UID: "dcd95606-e3ca-4dd0-b331-6c172d3ab6e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:38.002400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002359 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27lmn\" (UniqueName: \"kubernetes.io/projected/8136fa1f-fd5b-4cdc-8060-8f27cb301645-kube-api-access-27lmn\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.002400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002393 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.002400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002403 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8136fa1f-fd5b-4cdc-8060-8f27cb301645-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.002400 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002411 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.002728 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002419 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.002728 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.002429 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd8xs\" (UniqueName: \"kubernetes.io/projected/dcd95606-e3ca-4dd0-b331-6c172d3ab6e8-kube-api-access-dd8xs\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:38.615799 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.615772 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" Jun 10 19:10:38.616258 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.615766 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk" event={"ID":"8136fa1f-fd5b-4cdc-8060-8f27cb301645","Type":"ContainerDied","Data":"7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0"} Jun 10 19:10:38.616258 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.615893 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7972c5b98cbe1a680606fbc24f19b72ddf86c7105292bdba8d2fefbb9ffbc8c0" Jun 10 19:10:38.617851 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.617831 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" Jun 10 19:10:38.618010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.617874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6" event={"ID":"dcd95606-e3ca-4dd0-b331-6c172d3ab6e8","Type":"ContainerDied","Data":"a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811"} Jun 10 19:10:38.618010 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.617915 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2f13718842ce7e61fd60d11ce1ef8cd5a51fe4785c3956c3b19a2cefa4aa811" Jun 10 19:10:38.760500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.760473 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:38.911793 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.911761 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util\") pod \"c466b3e4-a460-4857-b3aa-310c89de020e\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " Jun 10 19:10:38.911988 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.911874 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle\") pod \"c466b3e4-a460-4857-b3aa-310c89de020e\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " Jun 10 19:10:38.911988 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.911900 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd2xg\" (UniqueName: \"kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg\") pod \"c466b3e4-a460-4857-b3aa-310c89de020e\" (UID: \"c466b3e4-a460-4857-b3aa-310c89de020e\") " Jun 10 19:10:38.920492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.912739 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle" (OuterVolumeSpecName: "bundle") pod "c466b3e4-a460-4857-b3aa-310c89de020e" (UID: "c466b3e4-a460-4857-b3aa-310c89de020e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:38.920492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.920281 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util" (OuterVolumeSpecName: "util") pod "c466b3e4-a460-4857-b3aa-310c89de020e" (UID: "c466b3e4-a460-4857-b3aa-310c89de020e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:10:38.921143 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:38.921120 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg" (OuterVolumeSpecName: "kube-api-access-gd2xg") pod "c466b3e4-a460-4857-b3aa-310c89de020e" (UID: "c466b3e4-a460-4857-b3aa-310c89de020e"). InnerVolumeSpecName "kube-api-access-gd2xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:10:39.012819 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.012774 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:39.013002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.012834 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c466b3e4-a460-4857-b3aa-310c89de020e-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:39.013002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.012845 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd2xg\" (UniqueName: \"kubernetes.io/projected/c466b3e4-a460-4857-b3aa-310c89de020e-kube-api-access-gd2xg\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:10:39.629669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.629630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" event={"ID":"c466b3e4-a460-4857-b3aa-310c89de020e","Type":"ContainerDied","Data":"72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e"} Jun 10 19:10:39.630026 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.629690 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72b4ae0d6bfd55d877e09da388763f1de5996d485a1a0ac2bd7ef7f7f08fa23e" Jun 10 19:10:39.630026 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:39.629642 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2" Jun 10 19:10:45.462861 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:45.462774 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:46.064021 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:46.063970 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:47.149319 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:47.149283 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:50.292134 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:50.292091 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:53.786953 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.786912 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9"] Jun 10 19:10:53.787548 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787524 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="pull" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787552 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="pull" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787568 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="extract" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787593 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="extract" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787603 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="extract" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787615 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="extract" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787629 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="pull" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787637 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="pull" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787645 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="extract" Jun 10 19:10:53.787669 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787653 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787682 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787691 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787703 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787713 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787733 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787741 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787753 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787761 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787771 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="pull" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787779 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="pull" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787791 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787799 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="util" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787807 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="pull" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787815 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="pull" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787923 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8136fa1f-fd5b-4cdc-8060-8f27cb301645" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787935 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c466b3e4-a460-4857-b3aa-310c89de020e" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787945 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="11622bfb-597e-4f07-8034-b6e82f13d377" containerName="extract" Jun 10 19:10:53.788105 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.787954 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd95606-e3ca-4dd0-b331-6c172d3ab6e8" containerName="extract" Jun 10 19:10:53.791438 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.791413 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:53.794379 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.794352 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 19:10:53.794779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.794751 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 19:10:53.795252 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.795236 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9565g\"" Jun 10 19:10:53.811458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.811418 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9"] Jun 10 19:10:53.822705 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.822673 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:53.958610 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.958539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:53.958808 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:53.958622 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxfrw\" (UniqueName: \"kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.059139 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.059034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.059139 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.059086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxfrw\" (UniqueName: \"kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.059509 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.059485 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.085573 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.085523 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxfrw\" (UniqueName: \"kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.103433 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.103389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:10:54.250804 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.250776 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9"] Jun 10 19:10:54.252819 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:10:54.252791 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0883834c_3f9c_4cb3_bb4d_a786494573fe.slice/crio-76ee4b600781e3d64b3ddd96cbf4e98d9830a9cadba5f3284f6103e7b9267a8b WatchSource:0}: Error finding container 76ee4b600781e3d64b3ddd96cbf4e98d9830a9cadba5f3284f6103e7b9267a8b: Status 404 returned error can't find the container with id 76ee4b600781e3d64b3ddd96cbf4e98d9830a9cadba5f3284f6103e7b9267a8b Jun 10 19:10:54.501798 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.501763 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:54.721280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:54.721241 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" event={"ID":"0883834c-3f9c-4cb3-bb4d-a786494573fe","Type":"ContainerStarted","Data":"76ee4b600781e3d64b3ddd96cbf4e98d9830a9cadba5f3284f6103e7b9267a8b"} Jun 10 19:10:56.506566 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:56.506534 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:56.815914 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:56.815813 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:10:59.127149 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:10:59.127109 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:00.486470 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:00.486433 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:00.584445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:00.584408 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:00.877533 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:00.877426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:00.941148 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:00.941112 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:02.778924 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:02.778889 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" event={"ID":"0883834c-3f9c-4cb3-bb4d-a786494573fe","Type":"ContainerStarted","Data":"4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99"} Jun 10 19:11:02.779334 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:02.779017 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:02.809769 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:02.809708 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" podStartSLOduration=1.402778246 podStartE2EDuration="9.809685973s" totalImagesPullingTime="8.406907727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:02.807780475 +0000 UTC m=+725.762745415" watchObservedRunningTime="2026-06-10 19:11:02.809685973 +0000 UTC m=+725.764650918" Jun 10 19:11:05.329845 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:05.329814 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:05.430786 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:05.430753 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:05.748424 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:05.748366 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:06.245242 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:06.245203 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:12.960715 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:12.960677 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:13.040684 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:13.040644 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:13.788005 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:13.787959 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:14.694718 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.694677 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd"] Jun 10 19:11:14.700024 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.699986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.725356 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.725319 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd"] Jun 10 19:11:14.763367 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.763324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.763572 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.763463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pp6\" (UniqueName: \"kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.864320 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.864272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pp6\" (UniqueName: \"kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.864508 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.864340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.864731 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.864713 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:14.878053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:14.878013 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pp6\" (UniqueName: \"kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:15.010494 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.010382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:15.176395 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.176365 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd"] Jun 10 19:11:15.178970 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:11:15.178927 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2143fb5f_12d7_40b3_8a9d_75b39cba56af.slice/crio-d0842a1d1cd6242242493e9cbd8d78bf033ae824228bbdaf5af57d949dc826cc WatchSource:0}: Error finding container d0842a1d1cd6242242493e9cbd8d78bf033ae824228bbdaf5af57d949dc826cc: Status 404 returned error can't find the container with id d0842a1d1cd6242242493e9cbd8d78bf033ae824228bbdaf5af57d949dc826cc Jun 10 19:11:15.432516 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.432481 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd"] Jun 10 19:11:15.439959 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.439900 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd"] Jun 10 19:11:15.449783 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.449742 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9"] Jun 10 19:11:15.450062 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.450033 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" containerName="manager" containerID="cri-o://4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99" gracePeriod=2 Jun 10 19:11:15.461458 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:15.461406 2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0883834c-3f9c-4cb3-bb4d-a786494573fe\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:15.462323 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.462256 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9"] Jun 10 19:11:15.476771 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.476734 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:15.477172 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477158 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" containerName="manager" Jun 10 19:11:15.477172 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477173 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" containerName="manager" Jun 10 19:11:15.477298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477199 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" containerName="manager" Jun 10 19:11:15.477298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477204 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" containerName="manager" Jun 10 19:11:15.477298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477281 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" containerName="manager" Jun 10 19:11:15.477298 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.477297 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" containerName="manager" Jun 10 19:11:15.481097 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.481066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.503843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.503800 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:15.523276 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:15.523234 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fhwn9\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:15.571278 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.571244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.571434 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.571329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx92t\" (UniqueName: \"kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.672819 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.672774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.673040 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.672833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx92t\" (UniqueName: \"kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.673294 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.673268 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.682489 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.682453 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx92t\" (UniqueName: \"kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6px\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.694615 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.694563 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:15.773658 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.773620 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxfrw\" (UniqueName: \"kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw\") pod \"0883834c-3f9c-4cb3-bb4d-a786494573fe\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " Jun 10 19:11:15.774146 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.773697 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume\") pod \"0883834c-3f9c-4cb3-bb4d-a786494573fe\" (UID: \"0883834c-3f9c-4cb3-bb4d-a786494573fe\") " Jun 10 19:11:15.774317 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.774290 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0883834c-3f9c-4cb3-bb4d-a786494573fe" (UID: "0883834c-3f9c-4cb3-bb4d-a786494573fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:11:15.775831 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.775805 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw" (OuterVolumeSpecName: "kube-api-access-gxfrw") pod "0883834c-3f9c-4cb3-bb4d-a786494573fe" (UID: "0883834c-3f9c-4cb3-bb4d-a786494573fe"). InnerVolumeSpecName "kube-api-access-gxfrw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:11:15.831222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.831173 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:15.862806 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.862772 2580 generic.go:356] "Generic (PLEG): container finished" podID="0883834c-3f9c-4cb3-bb4d-a786494573fe" containerID="4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99" exitCode=0 Jun 10 19:11:15.863003 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.862820 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fhwn9" Jun 10 19:11:15.863003 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.862874 2580 scope.go:117] "RemoveContainer" containerID="4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99" Jun 10 19:11:15.865532 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:15.865499 2580 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" container="manager" Jun 10 19:11:15.877338 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.877305 2580 scope.go:117] "RemoveContainer" containerID="4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99" Jun 10 19:11:15.877731 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.877710 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxfrw\" (UniqueName: \"kubernetes.io/projected/0883834c-3f9c-4cb3-bb4d-a786494573fe-kube-api-access-gxfrw\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:15.877818 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.877735 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0883834c-3f9c-4cb3-bb4d-a786494573fe-extensions-socket-volume\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:15.878015 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:15.877988 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99\": container with ID starting with 4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99 not found: ID does not exist" containerID="4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99" Jun 10 19:11:15.878150 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:15.878125 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99"} err="failed to get container status \"4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99\": rpc error: code = NotFound desc = could not find container \"4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99\": container with ID starting with 4826f40c79579af4e65a4b94051bf318a9cef9727376d5da8c2199133fab7e99 not found: ID does not exist" Jun 10 19:11:16.005057 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.005031 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:16.007181 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:11:16.007154 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3660f8_8c31_414c_9047_17ad942ddbdc.slice/crio-1f022aef967298c53b17af75920a06b79b4407675aeed5483fa710e7545cfc92 WatchSource:0}: Error finding container 1f022aef967298c53b17af75920a06b79b4407675aeed5483fa710e7545cfc92: Status 404 returned error can't find the container with id 1f022aef967298c53b17af75920a06b79b4407675aeed5483fa710e7545cfc92 Jun 10 19:11:16.873779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.873730 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" containerName="manager" containerID="cri-o://ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd" gracePeriod=2 Jun 10 19:11:16.875451 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.875423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" event={"ID":"6b3660f8-8c31-414c-9047-17ad942ddbdc","Type":"ContainerStarted","Data":"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14"} Jun 10 19:11:16.875563 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.875472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" event={"ID":"6b3660f8-8c31-414c-9047-17ad942ddbdc","Type":"ContainerStarted","Data":"1f022aef967298c53b17af75920a06b79b4407675aeed5483fa710e7545cfc92"} Jun 10 19:11:16.875563 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.875510 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:16.876381 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:16.876353 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:16.878641 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:16.878614 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:16.901860 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:16.901800 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" podStartSLOduration=1.901781194 podStartE2EDuration="1.901781194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:16.897685076 +0000 UTC m=+739.852650015" watchObservedRunningTime="2026-06-10 19:11:16.901781194 +0000 UTC m=+739.856746133" Jun 10 19:11:17.148125 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.148095 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:17.151097 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:17.151057 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:17.291064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.291018 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8pp6\" (UniqueName: \"kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6\") pod \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " Jun 10 19:11:17.291278 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.291131 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume\") pod \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\" (UID: \"2143fb5f-12d7-40b3-8a9d-75b39cba56af\") " Jun 10 19:11:17.291434 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.291409 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2143fb5f-12d7-40b3-8a9d-75b39cba56af" (UID: "2143fb5f-12d7-40b3-8a9d-75b39cba56af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:11:17.293402 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.293360 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6" (OuterVolumeSpecName: "kube-api-access-c8pp6") pod "2143fb5f-12d7-40b3-8a9d-75b39cba56af" (UID: "2143fb5f-12d7-40b3-8a9d-75b39cba56af"). InnerVolumeSpecName "kube-api-access-c8pp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:11:17.392131 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.392032 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2143fb5f-12d7-40b3-8a9d-75b39cba56af-extensions-socket-volume\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:17.392131 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.392066 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8pp6\" (UniqueName: \"kubernetes.io/projected/2143fb5f-12d7-40b3-8a9d-75b39cba56af-kube-api-access-c8pp6\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:17.489820 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:17.489761 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:17.493493 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.493461 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0883834c-3f9c-4cb3-bb4d-a786494573fe" path="/var/lib/kubelet/pods/0883834c-3f9c-4cb3-bb4d-a786494573fe/volumes" Jun 10 19:11:17.493830 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.493816 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" path="/var/lib/kubelet/pods/2143fb5f-12d7-40b3-8a9d-75b39cba56af/volumes" Jun 10 19:11:17.727932 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.727899 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:17.835088 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.835052 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:17.883262 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.883228 2580 generic.go:356] "Generic (PLEG): container finished" podID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" containerID="ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd" exitCode=2 Jun 10 19:11:17.883694 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.883281 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:17.883694 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.883328 2580 scope.go:117] "RemoveContainer" containerID="ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd" Jun 10 19:11:17.888227 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:17.888195 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-fbprd\" is forbidden: User \"system:node:ip-10-0-143-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-152.ec2.internal' and this object" podUID="2143fb5f-12d7-40b3-8a9d-75b39cba56af" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-fbprd" Jun 10 19:11:17.893275 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.893252 2580 scope.go:117] "RemoveContainer" containerID="ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd" Jun 10 19:11:17.893634 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:17.893610 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd\": container with ID starting with ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd not found: ID does not exist" containerID="ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd" Jun 10 19:11:17.893687 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:17.893643 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd"} err="failed to get container status \"ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd\": rpc error: code = NotFound desc = could not find container \"ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd\": container with ID starting with ede48433a280534d8513250e62b507ff475a78b3deb4a796fa0a1b0654fd3acd not found: ID does not exist" Jun 10 19:11:21.488537 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:21.488509 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:21.545525 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:21.545478 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:21.697332 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:21.697302 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:21.797804 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:21.797716 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:24.246282 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:24.246239 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:24.346910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:24.346875 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:27.885912 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:27.885876 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:30.793759 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:30.793718 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:30.890453 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:30.890417 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:35.530694 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:35.530655 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:35.634746 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:35.634706 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:39.345658 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:39.345628 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:39.407091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:39.407056 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:39.736914 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:39.736880 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:39.796277 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:39.796246 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:43.359842 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.359803 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:43.360250 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.360041 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" podUID="6b3660f8-8c31-414c-9047-17ad942ddbdc" containerName="manager" containerID="cri-o://25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14" gracePeriod=10 Jun 10 19:11:43.616185 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.616158 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:11:43.620240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.620218 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.631049 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.631025 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:43.634103 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.633951 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:11:43.739605 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.739551 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume\") pod \"6b3660f8-8c31-414c-9047-17ad942ddbdc\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " Jun 10 19:11:43.739802 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.739640 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx92t\" (UniqueName: \"kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t\") pod \"6b3660f8-8c31-414c-9047-17ad942ddbdc\" (UID: \"6b3660f8-8c31-414c-9047-17ad942ddbdc\") " Jun 10 19:11:43.739802 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.739777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsgv9\" (UniqueName: \"kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.739933 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.739829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.739992 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.739948 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b3660f8-8c31-414c-9047-17ad942ddbdc" (UID: "6b3660f8-8c31-414c-9047-17ad942ddbdc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:11:43.741809 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.741784 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t" (OuterVolumeSpecName: "kube-api-access-mx92t") pod "6b3660f8-8c31-414c-9047-17ad942ddbdc" (UID: "6b3660f8-8c31-414c-9047-17ad942ddbdc"). InnerVolumeSpecName "kube-api-access-mx92t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:11:43.767049 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.767021 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:43.841241 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.841199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsgv9\" (UniqueName: \"kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.841417 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.841276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.841417 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.841324 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b3660f8-8c31-414c-9047-17ad942ddbdc-extensions-socket-volume\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:43.841417 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.841334 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx92t\" (UniqueName: \"kubernetes.io/projected/6b3660f8-8c31-414c-9047-17ad942ddbdc-kube-api-access-mx92t\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:11:43.841707 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.841688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.853353 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.853330 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsgv9\" (UniqueName: \"kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9\") pod \"kuadrant-operator-controller-manager-86878c769f-kq4g4\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:43.866973 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.866901 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:43.938367 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:43.938330 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:44.048903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.048870 2580 generic.go:356] "Generic (PLEG): container finished" podID="6b3660f8-8c31-414c-9047-17ad942ddbdc" containerID="25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14" exitCode=0 Jun 10 19:11:44.049093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.048928 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" Jun 10 19:11:44.049093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.048952 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" event={"ID":"6b3660f8-8c31-414c-9047-17ad942ddbdc","Type":"ContainerDied","Data":"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14"} Jun 10 19:11:44.049093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.049008 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px" event={"ID":"6b3660f8-8c31-414c-9047-17ad942ddbdc","Type":"ContainerDied","Data":"1f022aef967298c53b17af75920a06b79b4407675aeed5483fa710e7545cfc92"} Jun 10 19:11:44.049093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.049034 2580 scope.go:117] "RemoveContainer" containerID="25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14" Jun 10 19:11:44.065505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.065484 2580 scope.go:117] "RemoveContainer" containerID="25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14" Jun 10 19:11:44.065831 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:11:44.065808 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14\": container with ID starting with 25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14 not found: ID does not exist" containerID="25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14" Jun 10 19:11:44.065922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.065840 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14"} err="failed to get container status \"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14\": rpc error: code = NotFound desc = could not find container \"25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14\": container with ID starting with 25344a24deee14ec0dd0806ce19556899aaa34237c1fb0be09bfd57ac06bbc14 not found: ID does not exist" Jun 10 19:11:44.077971 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.077943 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:44.089523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.089503 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6px"] Jun 10 19:11:44.090853 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:11:44.090830 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd694482f_d9fe_4d29_b49a_ea4b5da7f92f.slice/crio-b78ef770dda84cc9106d3ca82029343e252be141fbcd536c1ebb4172ac592bb6 WatchSource:0}: Error finding container b78ef770dda84cc9106d3ca82029343e252be141fbcd536c1ebb4172ac592bb6: Status 404 returned error can't find the container with id b78ef770dda84cc9106d3ca82029343e252be141fbcd536c1ebb4172ac592bb6 Jun 10 19:11:44.093319 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:44.093296 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:11:45.057730 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:45.057687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" event={"ID":"d694482f-d9fe-4d29-b49a-ea4b5da7f92f","Type":"ContainerStarted","Data":"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5"} Jun 10 19:11:45.058191 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:45.057754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" event={"ID":"d694482f-d9fe-4d29-b49a-ea4b5da7f92f","Type":"ContainerStarted","Data":"b78ef770dda84cc9106d3ca82029343e252be141fbcd536c1ebb4172ac592bb6"} Jun 10 19:11:45.058191 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:45.057883 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:45.079838 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:45.079763 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" podStartSLOduration=2.079747989 podStartE2EDuration="2.079747989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:11:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:45.078245496 +0000 UTC m=+768.033210435" watchObservedRunningTime="2026-06-10 19:11:45.079747989 +0000 UTC m=+768.034712919" Jun 10 19:11:45.485926 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:45.485891 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3660f8-8c31-414c-9047-17ad942ddbdc" path="/var/lib/kubelet/pods/6b3660f8-8c31-414c-9047-17ad942ddbdc/volumes" Jun 10 19:11:51.144538 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:51.144494 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:51.244322 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:51.244287 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:54.443976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:54.443921 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:54.531564 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:54.531533 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:54.988179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:54.988138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:55.148489 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:55.148459 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:56.068601 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:56.068561 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:11:59.687311 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:59.687274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:11:59.782015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:11:59.781983 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:02.601815 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:02.601775 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:02.725645 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:02.725598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:04.114189 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:04.114153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:04.602844 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:04.602814 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:04.728087 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:04.728057 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:04.830967 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:04.830936 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:05.006272 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.006235 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:12:05.006721 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.006707 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3660f8-8c31-414c-9047-17ad942ddbdc" containerName="manager" Jun 10 19:12:05.006777 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.006723 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3660f8-8c31-414c-9047-17ad942ddbdc" containerName="manager" Jun 10 19:12:05.006814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.006784 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3660f8-8c31-414c-9047-17ad942ddbdc" containerName="manager" Jun 10 19:12:05.011049 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.011028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.013789 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.013771 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vbxfk\"" Jun 10 19:12:05.013904 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.013771 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 19:12:05.023984 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.023959 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:12:05.060095 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.060061 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:12:05.140811 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.140774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7b5a6c9-e755-4368-adb6-a2d406030f4b-config-file\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.141232 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.140828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjxq5\" (UniqueName: \"kubernetes.io/projected/d7b5a6c9-e755-4368-adb6-a2d406030f4b-kube-api-access-rjxq5\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.241520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.241475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7b5a6c9-e755-4368-adb6-a2d406030f4b-config-file\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.241520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.241524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjxq5\" (UniqueName: \"kubernetes.io/projected/d7b5a6c9-e755-4368-adb6-a2d406030f4b-kube-api-access-rjxq5\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.242169 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.242148 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d7b5a6c9-e755-4368-adb6-a2d406030f4b-config-file\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.251521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.251499 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjxq5\" (UniqueName: \"kubernetes.io/projected/d7b5a6c9-e755-4368-adb6-a2d406030f4b-kube-api-access-rjxq5\") pod \"limitador-limitador-54d6d988d5-2q47p\" (UID: \"d7b5a6c9-e755-4368-adb6-a2d406030f4b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.322639 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.322529 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:05.482110 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:12:05.482081 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b5a6c9_e755_4368_adb6_a2d406030f4b.slice/crio-f8a87b30132c5daafdd58136fa0462a6e4fbc3a7ce11f2ceb92456ac00071441 WatchSource:0}: Error finding container f8a87b30132c5daafdd58136fa0462a6e4fbc3a7ce11f2ceb92456ac00071441: Status 404 returned error can't find the container with id f8a87b30132c5daafdd58136fa0462a6e4fbc3a7ce11f2ceb92456ac00071441 Jun 10 19:12:05.489511 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.489486 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:12:05.501557 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.501529 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:05.601901 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:05.601794 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:06.195006 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:06.194966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" event={"ID":"d7b5a6c9-e755-4368-adb6-a2d406030f4b","Type":"ContainerStarted","Data":"f8a87b30132c5daafdd58136fa0462a6e4fbc3a7ce11f2ceb92456ac00071441"} Jun 10 19:12:09.215816 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:09.215779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" event={"ID":"d7b5a6c9-e755-4368-adb6-a2d406030f4b","Type":"ContainerStarted","Data":"f2bedf5d60909290484fc67304223a3f98abc0ee498b85a845297eca299201f1"} Jun 10 19:12:09.216240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:09.215906 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:09.235713 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:09.235661 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" podStartSLOduration=2.549954046 podStartE2EDuration="5.235644945s" totalImagesPullingTime="2.685690899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:12:09.233346375 +0000 UTC m=+792.188311316" watchObservedRunningTime="2026-06-10 19:12:09.235644945 +0000 UTC m=+792.190609885" Jun 10 19:12:20.223241 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:20.223154 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2q47p" Jun 10 19:12:25.732248 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:25.732176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:25.825710 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:25.825671 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:26.196902 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:26.196863 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:38.943887 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:38.943845 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:39.041185 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:39.041153 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:39.212380 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:39.212295 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:12:40.166278 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.166234 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6"] Jun 10 19:12:40.174104 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.174076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.177154 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.177128 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 19:12:40.177439 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.177128 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 19:12:40.178376 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.178354 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xdr77\"" Jun 10 19:12:40.182152 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.181796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6"] Jun 10 19:12:40.267930 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.267887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bqtc\" (UniqueName: \"kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.268176 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.267972 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.268176 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.268010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.369496 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.369457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bqtc\" (UniqueName: \"kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.369708 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.369528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.369708 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.369554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.370001 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.369981 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.370001 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.369994 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.380610 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.380562 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bqtc\" (UniqueName: \"kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.485170 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.485075 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:40.628693 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:40.628662 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6"] Jun 10 19:12:40.630158 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:12:40.630133 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9e8813_32d7_4c1e_80a9_30ffedfc8f0f.slice/crio-5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238 WatchSource:0}: Error finding container 5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238: Status 404 returned error can't find the container with id 5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238 Jun 10 19:12:41.423543 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:41.423507 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerID="93b16d89e2008c6299c81013ee39ea83d399114f89c3943811ed8e4882357b60" exitCode=0 Jun 10 19:12:41.423989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:41.423606 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" event={"ID":"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f","Type":"ContainerDied","Data":"93b16d89e2008c6299c81013ee39ea83d399114f89c3943811ed8e4882357b60"} Jun 10 19:12:41.423989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:41.423700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" event={"ID":"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f","Type":"ContainerStarted","Data":"5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238"} Jun 10 19:12:42.432747 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:42.432713 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerID="5e4ca53a22ccf4f721e41f4089fd760a50848b6604a23aa68151f5b136502adf" exitCode=0 Jun 10 19:12:42.433108 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:42.432789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" event={"ID":"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f","Type":"ContainerDied","Data":"5e4ca53a22ccf4f721e41f4089fd760a50848b6604a23aa68151f5b136502adf"} Jun 10 19:12:43.440820 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:43.440785 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerID="2fb6ed7a0de93cec15da8e9b0004d202eb625a23503d82076e3095d4e1f5051e" exitCode=0 Jun 10 19:12:43.441260 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:43.440872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" event={"ID":"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f","Type":"ContainerDied","Data":"2fb6ed7a0de93cec15da8e9b0004d202eb625a23503d82076e3095d4e1f5051e"} Jun 10 19:12:44.592927 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.592903 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:44.708445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.708333 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle\") pod \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " Jun 10 19:12:44.708643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.708461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bqtc\" (UniqueName: \"kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc\") pod \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " Jun 10 19:12:44.708643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.708502 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util\") pod \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\" (UID: \"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f\") " Jun 10 19:12:44.708911 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.708881 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle" (OuterVolumeSpecName: "bundle") pod "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" (UID: "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:12:44.710546 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.710525 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc" (OuterVolumeSpecName: "kube-api-access-6bqtc") pod "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" (UID: "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f"). InnerVolumeSpecName "kube-api-access-6bqtc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:12:44.714280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.714260 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util" (OuterVolumeSpecName: "util") pod "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" (UID: "3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:12:44.810265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.810207 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-bundle\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:12:44.810265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.810258 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bqtc\" (UniqueName: \"kubernetes.io/projected/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-kube-api-access-6bqtc\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:12:44.810265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:44.810269 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f-util\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:12:45.454568 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:45.454541 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" Jun 10 19:12:45.454793 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:45.454574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748lcks6" event={"ID":"3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f","Type":"ContainerDied","Data":"5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238"} Jun 10 19:12:45.454793 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:12:45.454652 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5777a40a8dd9cb3b1bdb957ee701a51e26831d8fc3ba3fb3f021cca6e7a94238" Jun 10 19:13:03.644976 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:03.644942 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:03.701117 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:03.701081 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:36.162638 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:36.162600 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:36.268317 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:36.268279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:41.564645 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:41.564610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:41.655568 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:41.655535 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:41.763848 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:41.763818 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:41.971053 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:41.971013 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:45.085496 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:45.085365 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:13:45.265467 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:13:45.265435 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:14:13.681943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:13.681908 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:14:14.375697 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.375665 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-g2z5l"] Jun 10 19:14:14.376142 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376129 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="util" Jun 10 19:14:14.376190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376144 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="util" Jun 10 19:14:14.376190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376161 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="pull" Jun 10 19:14:14.376190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376166 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="pull" Jun 10 19:14:14.376190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376173 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="extract" Jun 10 19:14:14.376190 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376179 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="extract" Jun 10 19:14:14.376342 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.376255 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f9e8813-32d7-4c1e-80a9-30ffedfc8f0f" containerName="extract" Jun 10 19:14:14.378873 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.378857 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:14.382525 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.382506 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xzjtz\"" Jun 10 19:14:14.383522 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.383505 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 19:14:14.391087 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.391058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-g2z5l"] Jun 10 19:14:14.512392 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.512361 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:14:14.546350 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.546314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj9zs\" (UniqueName: \"kubernetes.io/projected/d31fa919-f7a3-4fd7-a1d7-54ad74c750cb-kube-api-access-tj9zs\") pod \"payload-processing-699b6cd6c-g2z5l\" (UID: \"d31fa919-f7a3-4fd7-a1d7-54ad74c750cb\") " pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:14.647063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.646978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj9zs\" (UniqueName: \"kubernetes.io/projected/d31fa919-f7a3-4fd7-a1d7-54ad74c750cb-kube-api-access-tj9zs\") pod \"payload-processing-699b6cd6c-g2z5l\" (UID: \"d31fa919-f7a3-4fd7-a1d7-54ad74c750cb\") " pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:14.659673 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.659636 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj9zs\" (UniqueName: \"kubernetes.io/projected/d31fa919-f7a3-4fd7-a1d7-54ad74c750cb-kube-api-access-tj9zs\") pod \"payload-processing-699b6cd6c-g2z5l\" (UID: \"d31fa919-f7a3-4fd7-a1d7-54ad74c750cb\") " pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:14.690557 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.690522 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:14.773305 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.773267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:14:14.872231 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.872205 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-g2z5l"] Jun 10 19:14:14.873960 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:14:14.873933 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31fa919_f7a3_4fd7_a1d7_54ad74c750cb.slice/crio-11f7055b37d3a02c55f05738d52bcc7d0a50ad7beb3ba56a77a744ec446a9bc5 WatchSource:0}: Error finding container 11f7055b37d3a02c55f05738d52bcc7d0a50ad7beb3ba56a77a744ec446a9bc5: Status 404 returned error can't find the container with id 11f7055b37d3a02c55f05738d52bcc7d0a50ad7beb3ba56a77a744ec446a9bc5 Jun 10 19:14:14.997568 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:14.997534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" event={"ID":"d31fa919-f7a3-4fd7-a1d7-54ad74c750cb","Type":"ContainerStarted","Data":"11f7055b37d3a02c55f05738d52bcc7d0a50ad7beb3ba56a77a744ec446a9bc5"} Jun 10 19:14:18.021472 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:18.021433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" event={"ID":"d31fa919-f7a3-4fd7-a1d7-54ad74c750cb","Type":"ContainerStarted","Data":"ac492fd1d4df7fa35ac1a3fe09773741832a02c361adec9dc93495bab5156448"} Jun 10 19:14:18.021903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:18.021626 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:14:18.043612 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:18.043546 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" podStartSLOduration=1.858209335 podStartE2EDuration="4.04352804s" totalImagesPullingTime="2.185318705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:14:18.041690753 +0000 UTC m=+920.996655691" watchObservedRunningTime="2026-06-10 19:14:18.04352804 +0000 UTC m=+920.998492978" Jun 10 19:14:25.157192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:25.157138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:14:25.258309 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:25.258273 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:14:29.029929 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:14:29.029897 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-g2z5l" Jun 10 19:15:05.860513 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:05.860479 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:05.956545 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:05.956506 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:16.799636 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:16.799528 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:16.963193 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:16.963161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:23.872750 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:23.872709 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:24.259369 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:24.259336 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:15:30.890012 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.889970 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc"] Jun 10 19:15:30.893169 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.893143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.897932 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.897899 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 19:15:30.898102 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.898070 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 19:15:30.898527 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.898498 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g96pj\"" Jun 10 19:15:30.899132 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.899113 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 19:15:30.950000 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.949963 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:30.958523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.958492 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc"] Jun 10 19:15:30.975501 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975470 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.975796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975589 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebca81d7-6256-4138-9cee-a4907aab825d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.975796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.975796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.975796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:30.975796 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:30.975752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvfl\" (UniqueName: \"kubernetes.io/projected/ebca81d7-6256-4138-9cee-a4907aab825d-kube-api-access-ttvfl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076294 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076294 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvfl\" (UniqueName: \"kubernetes.io/projected/ebca81d7-6256-4138-9cee-a4907aab825d-kube-api-access-ttvfl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebca81d7-6256-4138-9cee-a4907aab825d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076838 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076875 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076843 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.076912 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.076872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.078800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.078766 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebca81d7-6256-4138-9cee-a4907aab825d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.079036 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.079019 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebca81d7-6256-4138-9cee-a4907aab825d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.087257 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.087234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvfl\" (UniqueName: \"kubernetes.io/projected/ebca81d7-6256-4138-9cee-a4907aab825d-kube-api-access-ttvfl\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2mnvc\" (UID: \"ebca81d7-6256-4138-9cee-a4907aab825d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.204795 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.204756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:31.373109 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.373082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc"] Jun 10 19:15:31.375333 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:15:31.375306 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebca81d7_6256_4138_9cee_a4907aab825d.slice/crio-eb0211fdcb6dd2ccd8b2791fe9b294bf5f4feb882ebcdbdfe36a361ad5b9dd58 WatchSource:0}: Error finding container eb0211fdcb6dd2ccd8b2791fe9b294bf5f4feb882ebcdbdfe36a361ad5b9dd58: Status 404 returned error can't find the container with id eb0211fdcb6dd2ccd8b2791fe9b294bf5f4feb882ebcdbdfe36a361ad5b9dd58 Jun 10 19:15:31.377304 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.377287 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:15:31.418429 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.418384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:15:31.477498 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:31.477407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" event={"ID":"ebca81d7-6256-4138-9cee-a4907aab825d","Type":"ContainerStarted","Data":"eb0211fdcb6dd2ccd8b2791fe9b294bf5f4feb882ebcdbdfe36a361ad5b9dd58"} Jun 10 19:15:35.504727 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:35.504684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" event={"ID":"ebca81d7-6256-4138-9cee-a4907aab825d","Type":"ContainerStarted","Data":"8d8bdc9b19a972bed399e0129bef3940e9f4231ab55e10a5abebc710f2ac7ffe"} Jun 10 19:15:36.511640 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:36.511605 2580 generic.go:356] "Generic (PLEG): container finished" podID="ebca81d7-6256-4138-9cee-a4907aab825d" containerID="8d8bdc9b19a972bed399e0129bef3940e9f4231ab55e10a5abebc710f2ac7ffe" exitCode=0 Jun 10 19:15:36.512102 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:36.511690 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" event={"ID":"ebca81d7-6256-4138-9cee-a4907aab825d","Type":"ContainerDied","Data":"8d8bdc9b19a972bed399e0129bef3940e9f4231ab55e10a5abebc710f2ac7ffe"} Jun 10 19:15:38.530912 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:38.530874 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" event={"ID":"ebca81d7-6256-4138-9cee-a4907aab825d","Type":"ContainerStarted","Data":"e0eb8a4416ae0a0f1d4d7a7fb2281bd4c4fd7db4a83e0461865fa529a9e0f014"} Jun 10 19:15:38.565458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:38.565402 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" podStartSLOduration=3.10198626 podStartE2EDuration="8.565385503s" totalImagesPullingTime="4.207204774s" totalInitContainerRuntime="1.256194469s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:15:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:15:38.5647601 +0000 UTC m=+1001.519725039" watchObservedRunningTime="2026-06-10 19:15:38.565385503 +0000 UTC m=+1001.520350440" Jun 10 19:15:41.205618 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:41.205560 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:41.206032 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:41.205639 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:41.218028 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:41.218001 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:41.560366 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:41.560272 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2mnvc" Jun 10 19:15:43.939643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:43.939601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:44.494254 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:44.494206 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:15:46.820825 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:46.820790 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:15:47.703968 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:15:47.703930 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:16:00.811121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:00.811085 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:16:01.808396 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:01.808344 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:16:09.144797 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:09.144759 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:16:16.094041 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.094001 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf"] Jun 10 19:16:16.108398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.108362 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.108613 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.108519 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf"] Jun 10 19:16:16.111413 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.111375 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 19:16:16.116920 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.116892 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:16:16.214874 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.214830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.215080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.214896 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c47593-bf28-4cfa-acf4-3c254a65634e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.215080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.214947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.215080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.214970 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf9cq\" (UniqueName: \"kubernetes.io/projected/f2c47593-bf28-4cfa-acf4-3c254a65634e-kube-api-access-lf9cq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.215080 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.215044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.215240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.215082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316214 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316169 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c47593-bf28-4cfa-acf4-3c254a65634e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf9cq\" (UniqueName: \"kubernetes.io/projected/f2c47593-bf28-4cfa-acf4-3c254a65634e-kube-api-access-lf9cq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316436 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316760 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316725 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.316863 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.316838 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.318613 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.318592 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2c47593-bf28-4cfa-acf4-3c254a65634e-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.318783 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.318765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c47593-bf28-4cfa-acf4-3c254a65634e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.325991 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.325966 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf9cq\" (UniqueName: \"kubernetes.io/projected/f2c47593-bf28-4cfa-acf4-3c254a65634e-kube-api-access-lf9cq\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-zcfkf\" (UID: \"f2c47593-bf28-4cfa-acf4-3c254a65634e\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.419222 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.419184 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:16:16.566911 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.566880 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf"] Jun 10 19:16:16.568259 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:16:16.568236 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c47593_bf28_4cfa_acf4_3c254a65634e.slice/crio-e2b0acf5cd639a49a53c4d41d5c1d79cb8d5d2f2f100c4516fa5d5eb885ea078 WatchSource:0}: Error finding container e2b0acf5cd639a49a53c4d41d5c1d79cb8d5d2f2f100c4516fa5d5eb885ea078: Status 404 returned error can't find the container with id e2b0acf5cd639a49a53c4d41d5c1d79cb8d5d2f2f100c4516fa5d5eb885ea078 Jun 10 19:16:16.769031 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.768923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" event={"ID":"f2c47593-bf28-4cfa-acf4-3c254a65634e","Type":"ContainerStarted","Data":"0ef23a49e370f37761d4e8c9c865ba859ee93b76c308c2fe980deab0e6e74614"} Jun 10 19:16:16.769031 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:16.768982 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" event={"ID":"f2c47593-bf28-4cfa-acf4-3c254a65634e","Type":"ContainerStarted","Data":"e2b0acf5cd639a49a53c4d41d5c1d79cb8d5d2f2f100c4516fa5d5eb885ea078"} Jun 10 19:16:17.098936 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:17.098835 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:16:36.057552 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:16:36.057510 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:17:26.311166 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:26.311127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:17:47.337517 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:47.337477 2580 generic.go:356] "Generic (PLEG): container finished" podID="f2c47593-bf28-4cfa-acf4-3c254a65634e" containerID="0ef23a49e370f37761d4e8c9c865ba859ee93b76c308c2fe980deab0e6e74614" exitCode=0 Jun 10 19:17:47.337986 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:47.337548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" event={"ID":"f2c47593-bf28-4cfa-acf4-3c254a65634e","Type":"ContainerDied","Data":"0ef23a49e370f37761d4e8c9c865ba859ee93b76c308c2fe980deab0e6e74614"} Jun 10 19:17:48.345747 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:48.345709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" event={"ID":"f2c47593-bf28-4cfa-acf4-3c254a65634e","Type":"ContainerStarted","Data":"905f548bfd34e97d1e8f34b89ee51927deab3f07d7f520c79625a969980aa70e"} Jun 10 19:17:48.366854 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:48.366791 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" podStartSLOduration=2.389509133 podStartE2EDuration="1m32.366772055s" totalImagesPullingTime="234.165766ms" totalInitContainerRuntime="1m29.743097156s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:17:48.365701524 +0000 UTC m=+1131.320666463" watchObservedRunningTime="2026-06-10 19:17:48.366772055 +0000 UTC m=+1131.321736992" Jun 10 19:17:56.420186 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:56.420145 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:17:56.420186 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:56.420193 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:17:56.432699 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:56.432671 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:17:57.417870 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:57.417838 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-zcfkf" Jun 10 19:17:59.237317 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:59.237272 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:17:59.338179 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:17:59.338138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:18:00.365574 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:00.365543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:18:00.462421 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:00.462388 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:18:22.182641 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:22.182554 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:18:25.524500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:25.524464 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:18:33.692609 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:33.692554 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:18:44.387089 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:44.387055 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:18:52.990555 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:18:52.990512 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:19:03.784955 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:03.784914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:19:12.485472 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:12.485439 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:19:23.185612 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:23.185559 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:19:31.095343 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:31.095296 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:19:32.199017 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:32.198981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:19:33.949177 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:33.949138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:19:54.893230 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:54.893142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:19:59.283037 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:19:59.282995 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:20:04.401857 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:04.401817 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:20:07.191783 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:07.191744 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:20:12.328900 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:12.328850 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:12.420857 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:12.420819 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:20.829760 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:20.829710 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:26.667843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:26.667798 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:26.768308 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:26.768273 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:35.684240 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:35.684203 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:20:52.092731 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:52.092693 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:20:58.785827 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:58.785789 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:20:58.880554 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:20:58.880516 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:22.756691 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:22.756600 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.067632 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.067597 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.129291 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.129254 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.211203 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.211154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.308404 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.308370 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.476804 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.476756 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:29.574655 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:29.574608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:30.589269 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:30.589233 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:21:45.996306 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:45.996269 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:46.113139 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:46.113104 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:46.216299 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:46.216264 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:47.581644 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:47.581605 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:21:51.966280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:51.966238 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:21:52.039003 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:21:52.038963 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:00.144163 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:00.144124 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:00.242431 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:00.242391 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:00.339531 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:00.339499 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:00.439489 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:00.439450 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:01.802135 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:01.802095 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:22:17.669504 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:17.669457 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:17.690813 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:17.690779 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:22:17.767405 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:17.767348 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:20.889848 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:20.889809 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:22:23.148970 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:23.148935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:23.250778 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:23.250740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:43.550001 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:43.549922 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:43.663643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:43.663604 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:43.813480 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:43.813385 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:49.492149 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:49.492108 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:49.604204 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:49.604162 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:49.692241 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:49.692202 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:49.854692 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:49.854598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:55.775681 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:55.775630 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:55.842107 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:55.842051 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:22:56.587408 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:56.587369 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:22:59.990886 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:22:59.990841 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:23:21.884810 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:23:21.884773 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:23:31.191758 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:23:31.191721 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:23:47.685109 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:23:47.685058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:23:56.087422 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:23:56.087386 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:24:06.258149 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:06.258106 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:24:11.565815 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:11.565778 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:24:11.625389 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:11.625347 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:24:13.490631 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:13.490539 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:24:21.292043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:21.292002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:24:54.288881 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:24:54.288846 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:03.288841 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:03.288805 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:05.985685 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:05.985644 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:11.788568 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:11.788515 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:19.687988 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:19.687950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:28.092651 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:28.092614 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:36.395844 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:36.395807 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:39.387957 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:39.387910 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:45.290732 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:45.290637 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:25:56.895493 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:25:56.895455 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:26:34.894271 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:26:34.894231 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:26:37.081505 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:26:37.081466 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:26:44.490159 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:26:44.490114 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:26:47.394081 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:26:47.394042 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:26:55.985041 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:26:55.985007 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:04.287323 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:04.287285 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:14.198726 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:14.198642 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:22.396064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:22.396030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:30.603163 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:30.603122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:33.802160 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:33.802120 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:40.002256 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:40.002211 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:48.183444 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:48.183395 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:27:48.684343 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:48.684307 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:27:49.404020 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:49.403977 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:27:57.594892 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:27:57.594850 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:06.391221 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:06.391183 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:15.000265 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:15.000222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:24.498941 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:24.498893 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:28.852034 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:28.851996 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:28:32.292393 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:32.292353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:41.188502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:41.188458 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:49.226002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:49.225909 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:28:59.292342 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:28:59.292301 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:29:07.493975 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:07.493942 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:29:29.113745 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:29.113686 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:29:59.400459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.400424 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:29:59.402756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.400648 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" podUID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" containerName="manager" containerID="cri-o://b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5" gracePeriod=10 Jun 10 19:29:59.673294 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.673264 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:29:59.785280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.785240 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume\") pod \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " Jun 10 19:29:59.785280 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.785285 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsgv9\" (UniqueName: \"kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9\") pod \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\" (UID: \"d694482f-d9fe-4d29-b49a-ea4b5da7f92f\") " Jun 10 19:29:59.785744 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.785717 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d694482f-d9fe-4d29-b49a-ea4b5da7f92f" (UID: "d694482f-d9fe-4d29-b49a-ea4b5da7f92f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:29:59.787488 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.787463 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9" (OuterVolumeSpecName: "kube-api-access-dsgv9") pod "d694482f-d9fe-4d29-b49a-ea4b5da7f92f" (UID: "d694482f-d9fe-4d29-b49a-ea4b5da7f92f"). InnerVolumeSpecName "kube-api-access-dsgv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:29:59.886931 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.886889 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsgv9\" (UniqueName: \"kubernetes.io/projected/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-kube-api-access-dsgv9\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:29:59.886931 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:29:59.886924 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d694482f-d9fe-4d29-b49a-ea4b5da7f92f-extensions-socket-volume\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:30:00.011072 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.010972 2580 generic.go:356] "Generic (PLEG): container finished" podID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" containerID="b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5" exitCode=0 Jun 10 19:30:00.011072 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.011019 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" Jun 10 19:30:00.011072 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.011058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" event={"ID":"d694482f-d9fe-4d29-b49a-ea4b5da7f92f","Type":"ContainerDied","Data":"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5"} Jun 10 19:30:00.011348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.011123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4" event={"ID":"d694482f-d9fe-4d29-b49a-ea4b5da7f92f","Type":"ContainerDied","Data":"b78ef770dda84cc9106d3ca82029343e252be141fbcd536c1ebb4172ac592bb6"} Jun 10 19:30:00.011348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.011155 2580 scope.go:117] "RemoveContainer" containerID="b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5" Jun 10 19:30:00.022018 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.021996 2580 scope.go:117] "RemoveContainer" containerID="b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5" Jun 10 19:30:00.022291 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:30:00.022270 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5\": container with ID starting with b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5 not found: ID does not exist" containerID="b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5" Jun 10 19:30:00.022383 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.022302 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5"} err="failed to get container status \"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5\": rpc error: code = NotFound desc = could not find container \"b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5\": container with ID starting with b59881957c9a5f549baf6b48cffdc85e4d5b7182beb3307d34762620d428c6a5 not found: ID does not exist" Jun 10 19:30:00.039939 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.039906 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:30:00.050724 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.050688 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kq4g4"] Jun 10 19:30:00.153818 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.153782 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:30:00.154259 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.154247 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" containerName="manager" Jun 10 19:30:00.154310 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.154262 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" containerName="manager" Jun 10 19:30:00.154346 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.154340 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" containerName="manager" Jun 10 19:30:00.158720 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.158700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:30:00.162418 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.162398 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 19:30:00.162922 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.162896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 19:30:00.163078 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.162936 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-j2t27\"" Jun 10 19:30:00.167500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.167477 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:30:00.189978 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.189940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp64v\" (UniqueName: \"kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v\") pod \"maas-api-key-cleanup-29685330-fk4sb\" (UID: \"01a53aee-c6d9-4692-ac41-b8cfa3e81be4\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:30:00.291459 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.291358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp64v\" (UniqueName: \"kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v\") pod \"maas-api-key-cleanup-29685330-fk4sb\" (UID: \"01a53aee-c6d9-4692-ac41-b8cfa3e81be4\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:30:00.300108 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.300083 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp64v\" (UniqueName: \"kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v\") pod \"maas-api-key-cleanup-29685330-fk4sb\" (UID: \"01a53aee-c6d9-4692-ac41-b8cfa3e81be4\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:30:00.471706 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.471669 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:30:00.617146 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.617112 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:30:00.617880 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:30:00.617852 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a53aee_c6d9_4692_ac41_b8cfa3e81be4.slice/crio-4e196e2547f5909527e6a397dc4f39c30a740d67c51ec012d430e2b486e02b0c WatchSource:0}: Error finding container 4e196e2547f5909527e6a397dc4f39c30a740d67c51ec012d430e2b486e02b0c: Status 404 returned error can't find the container with id 4e196e2547f5909527e6a397dc4f39c30a740d67c51ec012d430e2b486e02b0c Jun 10 19:30:00.619822 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:00.619805 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:30:01.021561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:01.021528 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" event={"ID":"01a53aee-c6d9-4692-ac41-b8cfa3e81be4","Type":"ContainerStarted","Data":"4e196e2547f5909527e6a397dc4f39c30a740d67c51ec012d430e2b486e02b0c"} Jun 10 19:30:01.486441 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:01.486406 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d694482f-d9fe-4d29-b49a-ea4b5da7f92f" path="/var/lib/kubelet/pods/d694482f-d9fe-4d29-b49a-ea4b5da7f92f/volumes" Jun 10 19:30:04.043601 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:04.043540 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" event={"ID":"01a53aee-c6d9-4692-ac41-b8cfa3e81be4","Type":"ContainerStarted","Data":"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182"} Jun 10 19:30:04.063373 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:30:04.063314 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" podStartSLOduration=1.57010647 podStartE2EDuration="4.063297179s" totalImagesPullingTime="2.493190709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:30:04.061338744 +0000 UTC m=+1867.016303698" watchObservedRunningTime="2026-06-10 19:30:04.063297179 +0000 UTC m=+1867.018262118" Jun 10 19:31:00.022325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:00.016902 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:31:00.022325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:00.017267 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" podUID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" containerName="cleanup" containerID="cri-o://076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182" gracePeriod=30 Jun 10 19:31:05.549445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.549403 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l"] Jun 10 19:31:05.554416 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.554395 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.560664 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.560638 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9565g\"" Jun 10 19:31:05.570196 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.570159 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l"] Jun 10 19:31:05.631379 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.631343 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10670df4-a7bf-4f0e-878d-1e0969b71430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.631576 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.631426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzjnr\" (UniqueName: \"kubernetes.io/projected/10670df4-a7bf-4f0e-878d-1e0969b71430-kube-api-access-bzjnr\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.732085 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.732046 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10670df4-a7bf-4f0e-878d-1e0969b71430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.732272 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.732133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzjnr\" (UniqueName: \"kubernetes.io/projected/10670df4-a7bf-4f0e-878d-1e0969b71430-kube-api-access-bzjnr\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.732472 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.732452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10670df4-a7bf-4f0e-878d-1e0969b71430-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.743212 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.743186 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzjnr\" (UniqueName: \"kubernetes.io/projected/10670df4-a7bf-4f0e-878d-1e0969b71430-kube-api-access-bzjnr\") pod \"kuadrant-operator-controller-manager-86878c769f-dpb6l\" (UID: \"10670df4-a7bf-4f0e-878d-1e0969b71430\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:05.865850 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:05.865761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:06.025550 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:06.025520 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l"] Jun 10 19:31:06.026628 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:31:06.026565 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10670df4_a7bf_4f0e_878d_1e0969b71430.slice/crio-a59124d3534d0dd6f4b8dd13a009c80444d102c7e0534ba0029431ddf7749cee WatchSource:0}: Error finding container a59124d3534d0dd6f4b8dd13a009c80444d102c7e0534ba0029431ddf7749cee: Status 404 returned error can't find the container with id a59124d3534d0dd6f4b8dd13a009c80444d102c7e0534ba0029431ddf7749cee Jun 10 19:31:06.443043 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:06.443002 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" event={"ID":"10670df4-a7bf-4f0e-878d-1e0969b71430","Type":"ContainerStarted","Data":"2c9e36ce9461cd15f88a5d19db89c5908ff366135ad0ebea9f6b8c352e928303"} Jun 10 19:31:06.443239 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:06.443074 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:06.443239 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:06.443099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" event={"ID":"10670df4-a7bf-4f0e-878d-1e0969b71430","Type":"ContainerStarted","Data":"a59124d3534d0dd6f4b8dd13a009c80444d102c7e0534ba0029431ddf7749cee"} Jun 10 19:31:06.469030 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:06.468915 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" podStartSLOduration=1.468896468 podStartE2EDuration="1.468896468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:31:06.468432535 +0000 UTC m=+1929.423397479" watchObservedRunningTime="2026-06-10 19:31:06.468896468 +0000 UTC m=+1929.423861407" Jun 10 19:31:17.452455 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:17.452420 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dpb6l" Jun 10 19:31:24.895936 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:24.895885 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:31:29.890830 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:29.890784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:31:30.238040 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.238009 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:31:30.378172 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.378132 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp64v\" (UniqueName: \"kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v\") pod \"01a53aee-c6d9-4692-ac41-b8cfa3e81be4\" (UID: \"01a53aee-c6d9-4692-ac41-b8cfa3e81be4\") " Jun 10 19:31:30.380413 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.380383 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v" (OuterVolumeSpecName: "kube-api-access-gp64v") pod "01a53aee-c6d9-4692-ac41-b8cfa3e81be4" (UID: "01a53aee-c6d9-4692-ac41-b8cfa3e81be4"). InnerVolumeSpecName "kube-api-access-gp64v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:31:30.479756 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.479711 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp64v\" (UniqueName: \"kubernetes.io/projected/01a53aee-c6d9-4692-ac41-b8cfa3e81be4-kube-api-access-gp64v\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:31:30.598779 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.598740 2580 generic.go:356] "Generic (PLEG): container finished" podID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" containerID="076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182" exitCode=137 Jun 10 19:31:30.598987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.598783 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" Jun 10 19:31:30.598987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.598788 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" event={"ID":"01a53aee-c6d9-4692-ac41-b8cfa3e81be4","Type":"ContainerDied","Data":"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182"} Jun 10 19:31:30.598987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.598911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb" event={"ID":"01a53aee-c6d9-4692-ac41-b8cfa3e81be4","Type":"ContainerDied","Data":"4e196e2547f5909527e6a397dc4f39c30a740d67c51ec012d430e2b486e02b0c"} Jun 10 19:31:30.598987 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.598941 2580 scope.go:117] "RemoveContainer" containerID="076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182" Jun 10 19:31:30.609407 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.609387 2580 scope.go:117] "RemoveContainer" containerID="076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182" Jun 10 19:31:30.609739 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:31:30.609716 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182\": container with ID starting with 076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182 not found: ID does not exist" containerID="076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182" Jun 10 19:31:30.609799 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.609749 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182"} err="failed to get container status \"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182\": rpc error: code = NotFound desc = could not find container \"076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182\": container with ID starting with 076332de6345c91605f31d6d411718031409bf79efb53026c016153213b89182 not found: ID does not exist" Jun 10 19:31:30.623464 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.623432 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:31:30.627489 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:30.627462 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685330-fk4sb"] Jun 10 19:31:31.487567 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:31.487531 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" path="/var/lib/kubelet/pods/01a53aee-c6d9-4692-ac41-b8cfa3e81be4/volumes" Jun 10 19:31:55.785553 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:31:55.785468 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:00.388567 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:00.388530 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:09.585491 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:09.585454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:20.693420 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:20.693382 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:28.985561 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:28.985515 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:39.983889 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:39.983844 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:48.496662 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:48.496625 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:32:59.293923 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:32:59.293881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:33:08.085847 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:33:08.085811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:33:18.183340 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:33:18.183245 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:33:26.980917 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:33:26.980883 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:33:30.282073 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:33:30.282037 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:34:00.689131 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:34:00.689084 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:34:43.489858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:34:43.489779 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:34:52.192619 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:34:52.192568 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:00.694839 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:00.694803 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:09.288119 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:09.288077 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:18.184407 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:18.184374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:28.583984 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:28.583938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:37.787878 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:37.787841 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:45.193443 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:45.193397 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:35:53.883782 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:35:53.883740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:02.886058 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:02.886016 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:10.686813 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:10.686775 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:21.087473 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:21.087388 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:36.422781 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:36.422747 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:36:37.608656 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:37.608614 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:36:38.889187 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:38.889151 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:47.387445 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:47.387404 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:36:56.188797 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:36:56.188757 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:05.091002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:05.090963 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:12.432038 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:12.432004 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:37:21.309899 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:21.309860 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:37:21.690168 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:21.690132 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:30.088701 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:30.088658 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:39.010316 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:39.010277 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:47.691660 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:47.691566 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:37:56.285300 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:37:56.285261 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:05.501844 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:05.501806 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:13.792429 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:13.792393 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:25.184067 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:25.184029 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:34.190683 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:34.190649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:45.287529 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:45.287490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:38:54.789093 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:38:54.789048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:02.090390 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:02.090350 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:11.191091 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:11.191049 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:18.687643 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:18.687545 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:35.188211 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:35.188176 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:44.281945 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:44.281909 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:51.785706 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:51.785672 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:39:52.981947 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:52.981909 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:39:57.144564 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:57.144522 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:39:58.988623 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:39:58.988558 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:40:21.400118 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:21.400077 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:22.492536 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:22.492482 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:40:34.474750 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:34.474712 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:34.798042 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:34.797948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:40:36.182396 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:36.182364 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:36.241693 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:36.241660 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:36.357964 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:36.357932 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:36.444875 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:36.444838 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:39.387845 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:39.387811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2q47p"] Jun 10 19:40:40.055211 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:40.055176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:42.447220 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:42.447173 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:42.630124 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:42.630091 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:42.730878 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:42.730775 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:44.208163 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:44.208123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:48.800094 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.800055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:48.901090 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.901054 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:48.974646 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.974611 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:40:48.975098 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.975081 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" containerName="cleanup" Jun 10 19:40:48.975180 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.975100 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" containerName="cleanup" Jun 10 19:40:48.975180 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.975178 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a53aee-c6d9-4692-ac41-b8cfa3e81be4" containerName="cleanup" Jun 10 19:40:48.978502 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.978474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:48.982497 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.982467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bdf7e5b0-openshift-default-dockercfg-8hxph\"" Jun 10 19:40:48.994387 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:48.994359 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:40:49.021651 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.021615 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:49.080541 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080541 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.080814 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.081096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5np\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.081096 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.080949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.120724 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.120687 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:49.182518 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.182735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.182735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.182735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.182735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.182735 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5np\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182903 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182955 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.182978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183015 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.183015 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183329 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.183285 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.183787 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.183765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.185523 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.185493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.185678 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.185663 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.191521 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.191502 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.192519 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.192496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5np\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np\") pod \"e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.224069 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.223977 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:49.294100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.294059 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:49.465154 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.465122 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:40:49.466164 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:40:49.466138 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3742c0_5110_454a_88ad_353879315e33.slice/crio-d391b02bfe9372d530469a4b99bfff29dd248d8940033416053fae22ddc3de1f WatchSource:0}: Error finding container d391b02bfe9372d530469a4b99bfff29dd248d8940033416053fae22ddc3de1f: Status 404 returned error can't find the container with id d391b02bfe9372d530469a4b99bfff29dd248d8940033416053fae22ddc3de1f Jun 10 19:40:49.468410 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:49.468392 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:40:50.236275 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:50.236237 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" event={"ID":"5b3742c0-5110-454a-88ad-353879315e33","Type":"ContainerStarted","Data":"d391b02bfe9372d530469a4b99bfff29dd248d8940033416053fae22ddc3de1f"} Jun 10 19:40:52.319653 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:52.319609 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:52.492989 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:52.492953 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 19:40:52.493121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:52.493026 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 19:40:52.493121 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:52.493053 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 19:40:53.263226 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:53.263185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" event={"ID":"5b3742c0-5110-454a-88ad-353879315e33","Type":"ContainerStarted","Data":"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5"} Jun 10 19:40:53.285500 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:53.285444 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" podStartSLOduration=2.261385416 podStartE2EDuration="5.285426612s" totalImagesPullingTime="3.024041196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:40:53.283923864 +0000 UTC m=+2516.238888806" watchObservedRunningTime="2026-06-10 19:40:53.285426612 +0000 UTC m=+2516.240391550" Jun 10 19:40:53.295032 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:53.294997 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:53.300132 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:53.300107 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:54.270760 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:54.270732 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:54.271898 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:54.271865 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:40:55.298675 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:55.298636 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:56.491590 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:56.491541 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:40:56.528724 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:56.528692 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:56.629052 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:56.629015 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:40:57.289507 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:57.289466 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" podUID="5b3742c0-5110-454a-88ad-353879315e33" containerName="istio-proxy" containerID="cri-o://621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5" gracePeriod=30 Jun 10 19:40:59.722592 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:40:59.722548 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:41:02.553709 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.553639 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:41:02.622308 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622277 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622327 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622360 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622492 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622560 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:41:02.622703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622703 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622680 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5np\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622750 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622657 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:41:02.622910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622784 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.622910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622795 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:41:02.622910 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.622874 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket\") pod \"5b3742c0-5110-454a-88ad-353879315e33\" (UID: \"5b3742c0-5110-454a-88ad-353879315e33\") " Jun 10 19:41:02.623212 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623153 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:41:02.623288 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623208 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:41:02.623332 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623293 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-credential-socket\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.623332 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623312 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b3742c0-5110-454a-88ad-353879315e33-istiod-ca-cert\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.623332 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623327 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-data\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.623425 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623339 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-socket\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.623425 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.623352 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-workload-certs\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.624827 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.624798 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:41:02.624943 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.624926 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np" (OuterVolumeSpecName: "kube-api-access-vq5np") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "kube-api-access-vq5np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:41:02.625115 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.625092 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 19:41:02.625185 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.625117 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b3742c0-5110-454a-88ad-353879315e33" (UID: "5b3742c0-5110-454a-88ad-353879315e33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:41:02.724064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.724023 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-istio-token\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.724064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.724058 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b3742c0-5110-454a-88ad-353879315e33-istio-podinfo\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.724064 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.724071 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b3742c0-5110-454a-88ad-353879315e33-istio-envoy\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.724326 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.724083 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5np\" (UniqueName: \"kubernetes.io/projected/5b3742c0-5110-454a-88ad-353879315e33-kube-api-access-vq5np\") on node \"ip-10-0-143-152.ec2.internal\" DevicePath \"\"" Jun 10 19:41:02.800515 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.800482 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:41:02.974668 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:02.974630 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:41:03.328565 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.328457 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b3742c0-5110-454a-88ad-353879315e33" containerID="621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5" exitCode=0 Jun 10 19:41:03.328565 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.328506 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" Jun 10 19:41:03.328565 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.328541 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" event={"ID":"5b3742c0-5110-454a-88ad-353879315e33","Type":"ContainerDied","Data":"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5"} Jun 10 19:41:03.328879 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.328652 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh" event={"ID":"5b3742c0-5110-454a-88ad-353879315e33","Type":"ContainerDied","Data":"d391b02bfe9372d530469a4b99bfff29dd248d8940033416053fae22ddc3de1f"} Jun 10 19:41:03.328879 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.328684 2580 scope.go:117] "RemoveContainer" containerID="621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5" Jun 10 19:41:03.339444 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.339427 2580 scope.go:117] "RemoveContainer" containerID="621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5" Jun 10 19:41:03.339751 ip-10-0-143-152 kubenswrapper[2580]: E0610 19:41:03.339729 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5\": container with ID starting with 621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5 not found: ID does not exist" containerID="621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5" Jun 10 19:41:03.339838 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.339759 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5"} err="failed to get container status \"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5\": rpc error: code = NotFound desc = could not find container \"621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5\": container with ID starting with 621e71af2b657748809043b31e9b5feb1af6fd803eddfef6aa0fd6715120f0d5 not found: ID does not exist" Jun 10 19:41:03.370652 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.370615 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:41:03.373350 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.373327 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bdf7e5b0-openshift-default-54d756c55b-kbdmh"] Jun 10 19:41:03.487486 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:03.487450 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b3742c0-5110-454a-88ad-353879315e33" path="/var/lib/kubelet/pods/5b3742c0-5110-454a-88ad-353879315e33/volumes" Jun 10 19:41:13.712002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:13.711971 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66f6b98bc9-vgs9q_398a2933-c62e-49f6-b71b-0bbdfad78355/nginx/0.log" Jun 10 19:41:13.957619 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:13.957572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-b4knl_4a0f71c6-c76c-4463-9100-d79addd591e3/manager/0.log" Jun 10 19:41:14.091608 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:14.091509 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rt827_285c8cf6-158c-444d-ade6-0809f65d0f61/manager/0.log" Jun 10 19:41:14.344067 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:14.343985 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c96k6_f8887a73-bbe0-4f30-9332-5a92efc9da36/server/0.log" Jun 10 19:41:14.461520 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:14.461485 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-p52bk_bf04193d-baa8-4a89-a605-5cafccff7ec5/manager/0.log" Jun 10 19:41:14.573716 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:14.573685 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-4ptsz_5b91036e-38aa-4e2f-8ea6-9fa965ae220a/copy-manifests/0.log" Jun 10 19:41:14.581971 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:14.581950 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-4ptsz_5b91036e-38aa-4e2f-8ea6-9fa965ae220a/manager/0.log" Jun 10 19:41:15.637903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.637868 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/util/0.log" Jun 10 19:41:15.645911 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.645884 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/pull/0.log" Jun 10 19:41:15.654319 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.654295 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/extract/0.log" Jun 10 19:41:15.769147 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.769115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/util/0.log" Jun 10 19:41:15.775842 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.775820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/pull/0.log" Jun 10 19:41:15.782684 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.782664 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/extract/0.log" Jun 10 19:41:15.892192 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.892105 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/util/0.log" Jun 10 19:41:15.899008 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.898977 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/pull/0.log" Jun 10 19:41:15.905686 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:15.905655 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/extract/0.log" Jun 10 19:41:16.014347 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:16.014316 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/util/0.log" Jun 10 19:41:16.022063 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:16.022042 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/pull/0.log" Jun 10 19:41:16.028576 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:16.028552 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/extract/0.log" Jun 10 19:41:16.738175 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:16.738139 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dpb6l_10670df4-a7bf-4f0e-878d-1e0969b71430/manager/0.log" Jun 10 19:41:16.853348 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:16.853315 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2q47p_d7b5a6c9-e755-4368-adb6-a2d406030f4b/limitador/0.log" Jun 10 19:41:17.461852 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:17.461820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zq9hs_26227384-2bcb-4150-b6c6-da47e9003614/discovery/0.log" Jun 10 19:41:17.590919 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:17.590885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755b69b8fb-8pp5z_561c9e55-05d6-476b-9203-c9c15e210c22/kube-auth-proxy/0.log" Jun 10 19:41:18.090476 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:18.090440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-g2z5l_d31fa919-f7a3-4fd7-a1d7-54ad74c750cb/payload-processing/0.log" Jun 10 19:41:18.203932 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:18.203902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log" Jun 10 19:41:18.684678 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:18.684651 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2mnvc_ebca81d7-6256-4138-9cee-a4907aab825d/storage-initializer/0.log" Jun 10 19:41:18.691879 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:18.691854 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2mnvc_ebca81d7-6256-4138-9cee-a4907aab825d/main/0.log" Jun 10 19:41:19.204313 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:19.204284 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zcfkf_f2c47593-bf28-4cfa-acf4-3c254a65634e/storage-initializer/0.log" Jun 10 19:41:19.211941 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:19.211917 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-zcfkf_f2c47593-bf28-4cfa-acf4-3c254a65634e/main/0.log" Jun 10 19:41:23.648799 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:23.648755 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:41:23.746969 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:23.746935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" limit=1024 Jun 10 19:41:26.966424 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:26.966388 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bwqbf_ddbca1df-592e-4f20-8348-deea205c37b8/global-pull-secret-syncer/0.log" Jun 10 19:41:27.081978 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:27.081945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4qhgp_685c0a99-f2fb-4db5-82ff-cd76a5c3e06e/konnectivity-agent/0.log" Jun 10 19:41:27.237002 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:27.236923 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-152.ec2.internal_283531b98bcf29a0a103f2206962df28/haproxy/0.log" Jun 10 19:41:30.238660 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:30.238632 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-j44s2_cf467ab3-82a9-4277-abb4-d14e47b81dcc/sail-operator/0.log" Jun 10 19:41:31.374428 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.374399 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/extract/0.log" Jun 10 19:41:31.408625 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.408595 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/util/0.log" Jun 10 19:41:31.454838 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.454801 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tpcxk_8136fa1f-fd5b-4cdc-8060-8f27cb301645/pull/0.log" Jun 10 19:41:31.505273 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.505236 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/extract/0.log" Jun 10 19:41:31.601223 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.601194 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/util/0.log" Jun 10 19:41:31.678060 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.678035 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e07jld2_c466b3e4-a460-4857-b3aa-310c89de020e/pull/0.log" Jun 10 19:41:31.724826 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.724793 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/extract/0.log" Jun 10 19:41:31.769484 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.769454 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/util/0.log" Jun 10 19:41:31.803200 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.803174 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kgkds_11622bfb-597e-4f07-8034-b6e82f13d377/pull/0.log" Jun 10 19:41:31.835911 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.835863 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/extract/0.log" Jun 10 19:41:31.862346 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.862323 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/util/0.log" Jun 10 19:41:31.889736 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:31.889711 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hr6s6_dcd95606-e3ca-4dd0-b331-6c172d3ab6e8/pull/0.log" Jun 10 19:41:32.401933 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:32.401895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dpb6l_10670df4-a7bf-4f0e-878d-1e0969b71430/manager/0.log" Jun 10 19:41:32.442191 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:32.442162 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2q47p_d7b5a6c9-e755-4368-adb6-a2d406030f4b/limitador/0.log" Jun 10 19:41:34.147456 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.147429 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/alertmanager/0.log" Jun 10 19:41:34.176266 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.176236 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/config-reloader/0.log" Jun 10 19:41:34.204808 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.204780 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/kube-rbac-proxy-web/0.log" Jun 10 19:41:34.231846 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.231821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/kube-rbac-proxy/0.log" Jun 10 19:41:34.262634 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.262603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/kube-rbac-proxy-metric/0.log" Jun 10 19:41:34.294451 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.294421 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/prom-label-proxy/0.log" Jun 10 19:41:34.322088 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.322055 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c681fcd5-877b-4aae-a44d-f35565304950/init-config-reloader/0.log" Jun 10 19:41:34.529661 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.529632 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vv2kx_ca5430de-039c-4f62-8f5e-84fef464eecb/monitoring-plugin/0.log" Jun 10 19:41:34.570398 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.570369 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/node-exporter/0.log" Jun 10 19:41:34.646456 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.646420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/kube-rbac-proxy/0.log" Jun 10 19:41:34.720524 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.720498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-89ldj_cdaae407-5011-4e7f-898d-b72d0b336844/init-textfile/0.log" Jun 10 19:41:34.980476 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:34.980449 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/kube-rbac-proxy-main/0.log" Jun 10 19:41:35.018753 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.018720 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/kube-rbac-proxy-self/0.log" Jun 10 19:41:35.045102 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.045072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pgdgj_592b6b22-8d3f-4aa0-851c-0202c376ccb5/openshift-state-metrics/0.log" Jun 10 19:41:35.509245 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.509217 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865f76b6f-6tnmd_6f5dd1f0-fb72-4086-846e-c34bc7cdb97c/telemeter-client/0.log" Jun 10 19:41:35.543484 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.543453 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865f76b6f-6tnmd_6f5dd1f0-fb72-4086-846e-c34bc7cdb97c/reload/0.log" Jun 10 19:41:35.570784 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.570756 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6865f76b6f-6tnmd_6f5dd1f0-fb72-4086-846e-c34bc7cdb97c/kube-rbac-proxy/0.log" Jun 10 19:41:35.611054 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.611027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/thanos-query/0.log" Jun 10 19:41:35.640493 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.640467 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-web/0.log" Jun 10 19:41:35.666171 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.666146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy/0.log" Jun 10 19:41:35.698098 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.698072 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/prom-label-proxy/0.log" Jun 10 19:41:35.744858 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.744825 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-rules/0.log" Jun 10 19:41:35.806544 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:35.806463 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b5447564-hbwq4_9e1c3746-2411-45a2-8567-e8628bf35995/kube-rbac-proxy-metrics/0.log" Jun 10 19:41:37.204819 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:37.204786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-vkbnm_0e52c5b7-771a-4b8c-9df8-85020ffae4c8/networking-console-plugin/0.log" Jun 10 19:41:38.407800 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.407765 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-755b4c8f6c-7j25j_6cc617d4-29c4-4ce9-9194-87bc5b575d5f/console/0.log" Jun 10 19:41:38.464998 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.464967 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-h5qm5_11a1b745-3f58-40ea-ad59-6dc459c0639c/download-server/0.log" Jun 10 19:41:38.684354 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.684263 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj"] Jun 10 19:41:38.684805 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.684784 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b3742c0-5110-454a-88ad-353879315e33" containerName="istio-proxy" Jun 10 19:41:38.684805 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.684805 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b3742c0-5110-454a-88ad-353879315e33" containerName="istio-proxy" Jun 10 19:41:38.685000 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.684932 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b3742c0-5110-454a-88ad-353879315e33" containerName="istio-proxy" Jun 10 19:41:38.687321 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.687306 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.689948 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.689923 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wshmj\"/\"openshift-service-ca.crt\"" Jun 10 19:41:38.690122 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.690026 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wshmj\"/\"default-dockercfg-c7vhw\"" Jun 10 19:41:38.691258 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.691242 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wshmj\"/\"kube-root-ca.crt\"" Jun 10 19:41:38.697256 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.697235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj"] Jun 10 19:41:38.773936 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.773897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwqqn\" (UniqueName: \"kubernetes.io/projected/432b2259-3458-4bdc-aa27-ad82476c1e7c-kube-api-access-dwqqn\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.774151 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.773949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-sys\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.774151 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.773973 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-podres\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.774151 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.774022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-lib-modules\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.774151 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.774084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-proc\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875359 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwqqn\" (UniqueName: \"kubernetes.io/projected/432b2259-3458-4bdc-aa27-ad82476c1e7c-kube-api-access-dwqqn\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875359 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-sys\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-podres\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-lib-modules\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-proc\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-sys\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875614 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-podres\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875688 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-proc\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.875928 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.875708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/432b2259-3458-4bdc-aa27-ad82476c1e7c-lib-modules\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.886087 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.886069 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwqqn\" (UniqueName: \"kubernetes.io/projected/432b2259-3458-4bdc-aa27-ad82476c1e7c-kube-api-access-dwqqn\") pod \"perf-node-gather-daemonset-fzfkj\" (UID: \"432b2259-3458-4bdc-aa27-ad82476c1e7c\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:38.998493 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:38.998405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:39.148375 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.148344 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj"] Jun 10 19:41:39.150923 ip-10-0-143-152 kubenswrapper[2580]: W0610 19:41:39.150877 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod432b2259_3458_4bdc_aa27_ad82476c1e7c.slice/crio-d72f84f98ab5ec22a75986bac80a78175496eaf8eb887750ba609d5604cbb5a6 WatchSource:0}: Error finding container d72f84f98ab5ec22a75986bac80a78175496eaf8eb887750ba609d5604cbb5a6: Status 404 returned error can't find the container with id d72f84f98ab5ec22a75986bac80a78175496eaf8eb887750ba609d5604cbb5a6 Jun 10 19:41:39.214760 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.214737 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hlvbc_e71512aa-7d10-49de-bedb-0e8231a5329d/volume-data-source-validator/0.log" Jun 10 19:41:39.574385 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.574344 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" event={"ID":"432b2259-3458-4bdc-aa27-ad82476c1e7c","Type":"ContainerStarted","Data":"6e439e5c60c7759fecf1494f8149ad4df94f08d295b2c24f82fbe602cebd79b7"} Jun 10 19:41:39.574843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.574410 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" event={"ID":"432b2259-3458-4bdc-aa27-ad82476c1e7c","Type":"ContainerStarted","Data":"d72f84f98ab5ec22a75986bac80a78175496eaf8eb887750ba609d5604cbb5a6"} Jun 10 19:41:39.574843 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.574553 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:39.596037 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:39.595986 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" podStartSLOduration=1.595968145 podStartE2EDuration="1.595968145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:41:39.594515806 +0000 UTC m=+2562.549480747" watchObservedRunningTime="2026-06-10 19:41:39.595968145 +0000 UTC m=+2562.550933084" Jun 10 19:41:40.448006 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:40.447976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n6sst_5f56c490-be16-47ce-9ccf-3795d9b2b34a/dns/0.log" Jun 10 19:41:40.474542 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:40.474510 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n6sst_5f56c490-be16-47ce-9ccf-3795d9b2b34a/kube-rbac-proxy/0.log" Jun 10 19:41:40.558241 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:40.558209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4cjkb_5526f749-875e-415e-a78c-0f7085f53dda/dns-node-resolver/0.log" Jun 10 19:41:41.212999 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:41.212957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2pbsn_ec41b10a-79b5-411f-91d7-358481ed6e84/node-ca/0.log" Jun 10 19:41:42.357903 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:42.357866 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zq9hs_26227384-2bcb-4150-b6c6-da47e9003614/discovery/0.log" Jun 10 19:41:42.382145 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:42.382119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755b69b8fb-8pp5z_561c9e55-05d6-476b-9203-c9c15e210c22/kube-auth-proxy/0.log" Jun 10 19:41:42.608393 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:42.608302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-g2z5l_d31fa919-f7a3-4fd7-a1d7-54ad74c750cb/payload-processing/0.log" Jun 10 19:41:42.671516 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:42.671488 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log" Jun 10 19:41:43.327818 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.327785 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k67sp_8c5a2208-7ba4-4876-8d7b-b4f3f4917d95/serve-healthcheck-canary/0.log" Jun 10 19:41:43.901026 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.900994 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-sfv6h_e49142da-6ba2-429f-8d93-bcee57e9b251/insights-operator/0.log" Jun 10 19:41:43.902937 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.902917 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-sfv6h_e49142da-6ba2-429f-8d93-bcee57e9b251/insights-operator/1.log" Jun 10 19:41:43.936920 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.936894 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dzdh_679b1683-75a6-4761-a95a-d38b19d2cc19/kube-rbac-proxy/0.log" Jun 10 19:41:43.961811 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.961783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dzdh_679b1683-75a6-4761-a95a-d38b19d2cc19/exporter/0.log" Jun 10 19:41:43.990109 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:43.990082 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dzdh_679b1683-75a6-4761-a95a-d38b19d2cc19/extractor/0.log" Jun 10 19:41:45.592514 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:45.592484 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-fzfkj" Jun 10 19:41:46.387119 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.387027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66f6b98bc9-vgs9q_398a2933-c62e-49f6-b71b-0bbdfad78355/nginx/0.log" Jun 10 19:41:46.442274 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.442223 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-b4knl_4a0f71c6-c76c-4463-9100-d79addd591e3/manager/0.log" Jun 10 19:41:46.528146 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.528115 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rt827_285c8cf6-158c-444d-ade6-0809f65d0f61/manager/0.log" Jun 10 19:41:46.619218 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.619183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-c96k6_f8887a73-bbe0-4f30-9332-5a92efc9da36/server/0.log" Jun 10 19:41:46.669899 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.669868 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-p52bk_bf04193d-baa8-4a89-a605-5cafccff7ec5/manager/0.log" Jun 10 19:41:46.698855 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.698826 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-4ptsz_5b91036e-38aa-4e2f-8ea6-9fa965ae220a/manager/0.log" Jun 10 19:41:46.723100 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:46.723075 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-4ptsz_5b91036e-38aa-4e2f-8ea6-9fa965ae220a/copy-manifests/0.log" Jun 10 19:41:51.687434 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:51.687397 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zq9hs_26227384-2bcb-4150-b6c6-da47e9003614/discovery/0.log" Jun 10 19:41:51.699721 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:51.699693 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755b69b8fb-8pp5z_561c9e55-05d6-476b-9203-c9c15e210c22/kube-auth-proxy/0.log" Jun 10 19:41:51.863101 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:51.863062 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-g2z5l_d31fa919-f7a3-4fd7-a1d7-54ad74c750cb/payload-processing/0.log" Jun 10 19:41:51.876325 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:51.876297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log" Jun 10 19:41:53.036267 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:53.036234 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zq9hs_26227384-2bcb-4150-b6c6-da47e9003614/discovery/0.log" Jun 10 19:41:53.046884 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:53.046856 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755b69b8fb-8pp5z_561c9e55-05d6-476b-9203-c9c15e210c22/kube-auth-proxy/0.log" Jun 10 19:41:53.190821 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:53.190789 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-g2z5l_d31fa919-f7a3-4fd7-a1d7-54ad74c750cb/payload-processing/0.log" Jun 10 19:41:53.210224 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:53.210198 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log" Jun 10 19:41:54.143284 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.143251 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kb7lw_cee371e6-1887-43db-8bb1-b60d996daec9/migrator/0.log" Jun 10 19:41:54.168958 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.168929 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-kb7lw_cee371e6-1887-43db-8bb1-b60d996daec9/graceful-termination/0.log" Jun 10 19:41:54.580639 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.580572 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lktvm_62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0/kube-storage-version-migrator-operator/1.log" Jun 10 19:41:54.581383 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.581366 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-lktvm_62ae605a-d8c5-4fc0-b1ed-f3363f5bbed0/kube-storage-version-migrator-operator/0.log" Jun 10 19:41:54.964764 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.964727 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zq9hs_26227384-2bcb-4150-b6c6-da47e9003614/discovery/0.log" Jun 10 19:41:54.976458 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:54.976432 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-755b69b8fb-8pp5z_561c9e55-05d6-476b-9203-c9c15e210c22/kube-auth-proxy/0.log" Jun 10 19:41:55.165600 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:55.165557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-g2z5l_d31fa919-f7a3-4fd7-a1d7-54ad74c750cb/payload-processing/0.log" Jun 10 19:41:55.183026 ip-10-0-143-152 kubenswrapper[2580]: I0610 19:41:55.182996 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c4f6d6d85-79t56_a405376a-7488-472b-8452-e6598690754d/router/0.log"