Jul 07 19:08:00.350956 ip-10-0-142-232 systemd[1]: Starting Kubernetes Kubelet... Jul 07 19:08:00.693260 ip-10-0-142-232 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:08:00.693260 ip-10-0-142-232 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 19:08:00.693260 ip-10-0-142-232 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:08:00.693260 ip-10-0-142-232 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 19:08:00.693260 ip-10-0-142-232 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 19:08:00.694017 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.693933 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 19:08:00.698187 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698172 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.698187 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698187 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698190 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698193 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698196 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698200 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698202 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698205 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698212 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698215 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698218 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698220 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698222 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698225 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698227 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698230 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698232 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698235 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698237 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698240 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.698250 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698242 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698245 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698247 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698250 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698252 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698255 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698258 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698261 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698263 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698266 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698268 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698271 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698273 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698275 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698278 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698281 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698283 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698286 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698288 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698290 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.698707 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698293 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698296 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698298 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698300 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698303 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698305 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698307 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698310 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698312 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698315 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698317 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698319 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698322 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698327 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698330 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698333 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698336 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698339 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698341 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698344 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.699177 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698346 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698349 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698351 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698354 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698358 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698362 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698364 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698367 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698370 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698373 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698376 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698378 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698381 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698383 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698386 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698388 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698391 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698395 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698397 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.699658 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698400 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698402 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698406 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698409 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698411 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698414 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698417 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698420 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698422 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698425 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698427 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698430 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698433 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698435 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698437 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698439 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698442 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698444 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698447 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.698449 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.700118 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699154 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699162 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699166 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699169 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699172 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699176 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699179 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699181 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699184 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699187 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699190 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699192 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699194 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699197 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699199 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699202 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699204 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699207 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699211 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699213 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.700604 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699216 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699219 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699221 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699224 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699226 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699229 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699231 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699234 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699237 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699239 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699241 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699244 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699246 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699248 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699250 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699253 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699255 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699258 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699261 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699263 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.701119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699266 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699268 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699271 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699274 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699276 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699279 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699281 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699284 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699287 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699290 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699292 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699295 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699297 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699300 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699302 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699305 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699307 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699309 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699312 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699314 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.701603 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699316 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699319 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699322 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699324 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699327 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699329 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699332 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699334 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699337 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699339 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699341 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699345 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699348 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699351 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699353 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699357 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699359 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699362 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699364 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699366 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.702103 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699369 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699372 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699374 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699377 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699379 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699382 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699384 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699387 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699390 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699392 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699395 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699397 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699400 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699402 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699405 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699407 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699409 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699411 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699414 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699781 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.702575 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699786 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699789 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699791 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699794 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699797 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699800 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699802 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699805 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699807 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699810 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699813 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699815 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699818 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699822 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699825 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699828 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699831 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699834 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699836 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.703092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699839 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699842 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699844 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699847 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699849 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699852 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699854 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699857 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699860 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699862 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699865 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699870 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699873 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699876 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699878 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699881 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699883 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699886 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699889 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.703723 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699891 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699894 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699896 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699899 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699901 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699904 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699906 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699909 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699911 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699913 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699916 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699918 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699920 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699922 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699925 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699927 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699932 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699935 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699937 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699939 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.704186 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699942 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699944 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699946 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699951 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699954 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699957 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699960 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699963 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699965 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699968 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699971 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699974 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699977 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699980 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699983 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699986 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699988 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699990 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699993 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699996 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.704747 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.699998 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700000 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700003 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700005 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700008 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700010 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700012 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700015 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700018 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700021 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700023 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700026 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700029 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700031 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700034 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700036 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700039 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700041 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700043 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700046 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.705219 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700110 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700121 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700127 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700131 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700138 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700141 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700145 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700150 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700153 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700156 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700159 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700163 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700165 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700172 2576 flags.go:64] FLAG: --cgroup-root="" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700175 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700178 2576 flags.go:64] FLAG: --client-ca-file="" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700181 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700184 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700188 2576 flags.go:64] FLAG: --cluster-domain="" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700191 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700196 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700199 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700202 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700206 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 19:08:00.705706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700208 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700211 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700214 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700217 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700220 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700223 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700226 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700229 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700234 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700237 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700239 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700242 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700246 2576 flags.go:64] FLAG: --enable-server="true" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700250 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700253 2576 flags.go:64] FLAG: --event-burst="100" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700256 2576 flags.go:64] FLAG: --event-qps="50" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700259 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700262 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700265 2576 flags.go:64] FLAG: --eviction-hard="" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700268 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700271 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700274 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700276 2576 flags.go:64] FLAG: --eviction-soft="" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700279 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700282 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 19:08:00.706310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700284 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700287 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700289 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700294 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700296 2576 flags.go:64] FLAG: --feature-gates="" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700300 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700303 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700305 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700308 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700311 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700314 2576 flags.go:64] FLAG: --help="false" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700317 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-232.ec2.internal" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700320 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700322 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700325 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700328 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700331 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700334 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700337 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700341 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700344 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700347 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700350 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700353 2576 flags.go:64] FLAG: --kube-reserved="" Jul 07 19:08:00.706948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700355 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700358 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700361 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700363 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700366 2576 flags.go:64] FLAG: --lock-file="" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700368 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700371 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700374 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700378 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700381 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700384 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700388 2576 flags.go:64] FLAG: --logging-format="text" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700398 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700402 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700405 2576 flags.go:64] FLAG: --manifest-url="" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700408 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700412 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700415 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700418 2576 flags.go:64] FLAG: --max-pods="110" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700422 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700424 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700427 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700429 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700432 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700435 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 19:08:00.707522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700437 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700444 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700449 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700452 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700455 2576 flags.go:64] FLAG: --pod-cidr="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700458 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700464 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700466 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700469 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700472 2576 flags.go:64] FLAG: --port="10250" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700475 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700478 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0622a9ced5b9a1827" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700480 2576 flags.go:64] FLAG: --qos-reserved="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700483 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700486 2576 flags.go:64] FLAG: --register-node="true" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700488 2576 flags.go:64] FLAG: --register-with-taints="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700492 2576 flags.go:64] FLAG: --registry-burst="10" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700494 2576 flags.go:64] FLAG: --registry-qps="5" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700498 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700501 2576 flags.go:64] FLAG: --reserved-memory="" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700504 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700507 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700510 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700513 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700515 2576 flags.go:64] FLAG: --runonce="false" Jul 07 19:08:00.708143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700518 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700521 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700524 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700526 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700529 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700532 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700535 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700538 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700541 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700544 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700548 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700550 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700553 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700557 2576 flags.go:64] FLAG: --system-cgroups="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700560 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700565 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700568 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700571 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700575 2576 flags.go:64] FLAG: --tls-min-version="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700578 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700581 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700583 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700586 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700588 2576 flags.go:64] FLAG: --v="2" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700592 2576 flags.go:64] FLAG: --version="false" Jul 07 19:08:00.708773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700597 2576 flags.go:64] FLAG: --vmodule="" Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700600 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.700603 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700726 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700730 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700732 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700735 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700738 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700741 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700744 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700746 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700749 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700751 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700754 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700756 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700759 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700761 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700764 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700767 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700769 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.709362 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700772 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700775 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700777 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700779 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700782 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700784 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700787 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700790 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700794 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700797 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700799 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700802 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700805 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700807 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700810 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700812 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700814 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700817 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700821 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.709895 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700824 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700827 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700830 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700833 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700835 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700838 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700841 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700843 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700846 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700848 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700851 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700853 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700856 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700858 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700860 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700863 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700866 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700868 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700871 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700873 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.710344 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700875 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700878 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700880 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700883 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700885 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700888 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700890 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700893 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700896 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700899 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700902 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700905 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700908 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700911 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700913 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700915 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700918 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700920 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700922 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.710903 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700925 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700927 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700930 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700932 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700935 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700937 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700940 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700942 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700944 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700947 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700950 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700952 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700954 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700957 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700959 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700961 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700964 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700966 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700969 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700971 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.711358 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700974 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700976 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700978 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.700981 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.701510 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.708569 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.708583 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.709251 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.709258 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709325 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709331 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709334 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709336 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709339 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709342 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.711862 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709344 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709347 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709349 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709352 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709354 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709357 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709365 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709368 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709371 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709374 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709376 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709378 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709381 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709383 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709386 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709389 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709391 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709393 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709396 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709398 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.712221 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709400 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709403 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709406 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709409 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709412 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709416 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709420 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709422 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709425 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709428 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709436 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709439 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709443 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709446 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709450 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709453 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709456 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709459 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.712739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709461 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709469 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709472 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709474 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709476 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709479 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709481 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709484 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709486 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709489 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709491 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709494 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709496 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709498 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709501 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709503 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709506 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709509 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709512 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709514 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.713173 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709517 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709519 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709521 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709524 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709526 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709529 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709531 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709533 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709536 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709538 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709540 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709543 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709545 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709548 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709556 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709558 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709561 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709563 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709565 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709568 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.713656 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709570 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709573 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709575 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709577 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709580 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709582 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709584 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709587 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709589 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709592 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709595 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709597 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709599 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709602 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709604 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.714149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.709610 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709783 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709788 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709792 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709811 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709814 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709817 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709820 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709823 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709826 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709830 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709833 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709841 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709846 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709849 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709852 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709855 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709858 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709861 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 19:08:00.714527 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709864 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709867 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709870 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709872 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709875 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709878 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709880 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709884 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709886 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709889 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709892 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709894 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709897 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709900 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709903 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709906 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709908 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709911 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709913 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709916 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 19:08:00.715000 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709918 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709921 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709923 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709926 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709928 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709930 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709938 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709941 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709943 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709945 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709947 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709950 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709952 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709955 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709957 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709960 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709962 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709964 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709967 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709969 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 19:08:00.715469 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709972 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709974 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709977 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709979 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709981 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709983 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709986 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709988 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709990 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709993 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709995 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.709997 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710000 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710002 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710004 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710007 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710009 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710011 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710014 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 19:08:00.716041 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710021 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710024 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710026 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710028 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710031 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710033 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710038 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710041 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710043 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710045 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710048 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710050 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710053 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710055 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710058 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710060 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710063 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710065 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710067 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710070 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 19:08:00.716702 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710072 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:00.710074 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.710079 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.710191 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.712282 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.713504 2576 server.go:1019] "Starting client certificate rotation" Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.713618 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 19:08:00.717492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.713663 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 19:08:00.718046 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.718029 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 19:08:00.721318 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.721296 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 19:08:00.731576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.731556 2576 log.go:25] "Validated CRI v1 runtime API" Jul 07 19:08:00.734539 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.734505 2576 log.go:25] "Validated CRI v1 image API" Jul 07 19:08:00.735895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.735874 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 19:08:00.737966 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.737949 2576 fs.go:135] Filesystem UUIDs: map[6da0302a-61bd-4b07-b19a-3c1dc2975508:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f76f7b95-ada0-4c27-9027-ca8218748a24:/dev/nvme0n1p4] Jul 07 19:08:00.738028 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.737966 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 19:08:00.742824 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.742716 2576 manager.go:216] Machine: {Timestamp:2026-07-07 19:08:00.741533653 +0000 UTC m=+0.288301734 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099213 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20646dcab16a0ff4bc91c12a1e18c5 SystemUUID:ec20646d-cab1-6a0f-f4bc-91c12a1e18c5 BootID:95363771-7cbc-4f24-b7f8-f7161b05e1a9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:05:7e:be:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:05:7e:be:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:dc:37:4a:96:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 19:08:00.742824 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.742820 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 19:08:00.742972 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.742895 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 19:08:00.743146 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.743128 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 19:08:00.743830 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.743806 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 19:08:00.743964 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.743831 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 19:08:00.744505 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.744495 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 19:08:00.744536 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.744508 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 19:08:00.744536 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.744515 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 19:08:00.745051 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.745040 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 19:08:00.746359 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.746349 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 19:08:00.749992 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.749980 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 19:08:00.750106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750096 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 19:08:00.750141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750126 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 07 19:08:00.750141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750136 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 19:08:00.750191 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750151 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 19:08:00.750191 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750161 2576 kubelet.go:398] "Adding apiserver pod source" Jul 07 19:08:00.750191 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750171 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 19:08:00.750593 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750578 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 19:08:00.750648 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.750612 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 19:08:00.753238 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.753217 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 19:08:00.755197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.755179 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 19:08:00.755278 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.755219 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 19:08:00.756806 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756792 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756812 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756821 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756829 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756840 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756849 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756862 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 19:08:00.756874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756870 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 19:08:00.757090 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756880 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 19:08:00.757090 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756888 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 19:08:00.757090 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756901 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 19:08:00.757090 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.756910 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 19:08:00.757508 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.757496 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 19:08:00.757566 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.757511 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 19:08:00.759710 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.759685 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 19:08:00.759776 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.759693 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 19:08:00.760992 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.760979 2576 server.go:1268] "Started kubelet" Jul 07 19:08:00.761082 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.761053 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 19:08:00.761142 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.761102 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 19:08:00.761188 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.761048 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 19:08:00.761784 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.761764 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 19:08:00.761901 ip-10-0-142-232 systemd[1]: Started Kubernetes Kubelet. Jul 07 19:08:00.763449 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.762743 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 19:08:00.763449 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.762954 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 07 19:08:00.765350 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.765333 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 19:08:00.768025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.768009 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4p4ms" Jul 07 19:08:00.769558 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.769545 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 19:08:00.769613 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.769558 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 19:08:00.769741 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.769704 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:00.770329 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770316 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 19:08:00.770445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770399 2576 factory.go:55] Registering systemd factory Jul 07 19:08:00.770445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770447 2576 factory.go:223] Registration of the systemd container factory successfully Jul 07 19:08:00.770596 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770509 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 19:08:00.770596 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770519 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 19:08:00.770705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770607 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 07 19:08:00.770705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770648 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 07 19:08:00.770819 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770804 2576 factory.go:153] Registering CRI-O factory Jul 07 19:08:00.770868 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770823 2576 factory.go:223] Registration of the crio container factory successfully Jul 07 19:08:00.770902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770867 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 19:08:00.770902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770885 2576 factory.go:103] Registering Raw factory Jul 07 19:08:00.770902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.770897 2576 manager.go:1196] Started watching for new ooms in manager Jul 07 19:08:00.771335 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.770483 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-232.ec2.internal.18c0177d9ff8f07f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-232.ec2.internal,UID:ip-10-0-142-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-232.ec2.internal,},FirstTimestamp:2026-07-07 19:08:00.760959103 +0000 UTC m=+0.307727185,LastTimestamp:2026-07-07 19:08:00.760959103 +0000 UTC m=+0.307727185,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-232.ec2.internal,}" Jul 07 19:08:00.771377 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.771367 2576 manager.go:349] Starting recovery of all containers Jul 07 19:08:00.772963 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.772542 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 19:08:00.772963 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.772628 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 19:08:00.777093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.777060 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4p4ms" Jul 07 19:08:00.783265 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.783239 2576 manager.go:354] Recovery completed Jul 07 19:08:00.787449 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.787436 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.789578 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.789562 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.789657 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.789592 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.789657 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.789606 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:00.790115 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790099 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 19:08:00.790115 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790109 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.790115 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790112 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 19:08:00.790255 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790131 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 07 19:08:00.790787 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790771 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.790836 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790799 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.790836 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.790809 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:00.791924 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.791865 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-232.ec2.internal.18c0177da1ad9dd9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-232.ec2.internal,UID:ip-10-0-142-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-232.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-232.ec2.internal,},FirstTimestamp:2026-07-07 19:08:00.789577177 +0000 UTC m=+0.336345258,LastTimestamp:2026-07-07 19:08:00.789577177 +0000 UTC m=+0.336345258,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-232.ec2.internal,}" Jul 07 19:08:00.792028 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.792017 2576 policy_none.go:49] "None policy: Start" Jul 07 19:08:00.792063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.792038 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 19:08:00.792063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.792047 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 19:08:00.793958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.793946 2576 policy_none.go:47] "Start" Jul 07 19:08:00.832270 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832251 2576 manager.go:337] "Starting Device Plugin manager" Jul 07 19:08:00.832338 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.832282 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 19:08:00.832338 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832291 2576 server.go:87] "Starting device plugin registration server" Jul 07 19:08:00.832571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832558 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 19:08:00.832619 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832587 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 19:08:00.832719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832696 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 19:08:00.832837 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832821 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 19:08:00.832837 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.832835 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 19:08:00.833484 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.833457 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 19:08:00.833571 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.833505 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:00.893366 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.893345 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 19:08:00.895355 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.894652 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 19:08:00.895355 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.894696 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 19:08:00.895355 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.894723 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 19:08:00.895355 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.894776 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 19:08:00.897493 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.897466 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:00.933698 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.933668 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.934380 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.934363 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.934439 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.934401 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.934439 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.934412 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:00.934439 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.934436 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-232.ec2.internal" Jul 07 19:08:00.940811 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.940798 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-232.ec2.internal" Jul 07 19:08:00.940854 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.940817 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-232.ec2.internal\": node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:00.956735 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:00.956687 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:00.995129 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.995105 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal"] Jul 07 19:08:00.995221 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.995171 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.996543 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.996530 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.996653 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.996561 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.996653 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.996573 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:00.998858 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.998846 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.999064 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:00.999132 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999089 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:00.999621 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999602 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.999723 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999650 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.999723 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999694 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:00.999802 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999759 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:00.999802 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999797 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:00.999871 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:00.999823 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:01.002058 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.002043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.002134 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.002083 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 19:08:01.002791 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.002776 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 07 19:08:01.002876 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.002826 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 19:08:01.002876 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.002841 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 07 19:08:01.014175 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.014158 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-232.ec2.internal\" not found" node="ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.017710 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.017692 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-232.ec2.internal\" not found" node="ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.057438 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.057413 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.072194 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.072172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.072280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.072199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.072280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.072221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe84c148b4beb2400061983cd4783d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"8fe84c148b4beb2400061983cd4783d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.158013 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.157988 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.172346 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.172346 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.172462 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe84c148b4beb2400061983cd4783d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"8fe84c148b4beb2400061983cd4783d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.172462 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8fe84c148b4beb2400061983cd4783d3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"8fe84c148b4beb2400061983cd4783d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.172462 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172430 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.172462 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.172421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/384338fb9c8cd805cbb112da5251e876-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"384338fb9c8cd805cbb112da5251e876\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.258766 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.258713 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.317178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.317150 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.320454 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.320428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:01.359790 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.359768 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.460388 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.460351 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.560939 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.560867 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.595479 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.595453 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:01.661666 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.661639 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.713047 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.713020 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 19:08:01.713428 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.713145 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 19:08:01.713428 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.713179 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 19:08:01.762470 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.762439 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:01.785203 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.785176 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 19:03:02 +0000 UTC" deadline="2027-12-02 05:18:24.711122484 +0000 UTC" Jul 07 19:08:01.785203 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:01.785202 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12298h10m22.925923362s" Jul 07 19:08:01.863525 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:01.863497 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:03.287558 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:03.287523 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe84c148b4beb2400061983cd4783d3.slice/crio-cdc47a5d8b28a58a897649092ec010e8e60cade2efb177f8a154dbfe471f88a6 WatchSource:0}: Error finding container cdc47a5d8b28a58a897649092ec010e8e60cade2efb177f8a154dbfe471f88a6: Status 404 returned error can't find the container with id cdc47a5d8b28a58a897649092ec010e8e60cade2efb177f8a154dbfe471f88a6 Jul 07 19:08:03.287894 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:03.287871 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod384338fb9c8cd805cbb112da5251e876.slice/crio-f77c8158c535b3dcf0253d81df6437674c32269c4ef7eda5a38c1766c3e07f6d WatchSource:0}: Error finding container f77c8158c535b3dcf0253d81df6437674c32269c4ef7eda5a38c1766c3e07f6d: Status 404 returned error can't find the container with id f77c8158c535b3dcf0253d81df6437674c32269c4ef7eda5a38c1766c3e07f6d Jul 07 19:08:03.291734 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.291716 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:08:03.293240 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:03.293221 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:03.393667 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:03.393621 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 07 19:08:03.401573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.401549 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:03.438246 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.438188 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:03.499357 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.499336 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 07 19:08:03.511471 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.511441 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 19:08:03.512532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.512520 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 07 19:08:03.524924 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:03.524909 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 19:08:04.036073 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.036047 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:04.080482 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.080248 2576 apiserver.go:52] "Watching apiserver" Jul 07 19:08:04.088708 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.088684 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 19:08:04.090304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.090275 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bgjzx","kube-system/konnectivity-agent-pm6nf","kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x6gtf","openshift-dns/node-resolver-b6dj2","openshift-image-registry/node-ca-scl5n","openshift-network-diagnostics/network-check-target-bbt5n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal","openshift-multus/multus-additional-cni-plugins-t449w","openshift-multus/multus-x7lwf","openshift-multus/network-metrics-daemon-8sb6h","openshift-network-operator/iptables-alerter-5w8d2","openshift-ovn-kubernetes/ovnkube-node-qbdvk"] Jul 07 19:08:04.093138 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.093118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:04.093239 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.093204 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:04.095619 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.095072 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.097584 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.097561 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.098663 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.098644 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 19:08:04.098980 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.098961 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.099381 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.099364 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.099579 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.099558 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 19:08:04.099764 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.099740 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sw7c8\"" Jul 07 19:08:04.099883 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.099873 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.100011 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.099989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 19:08:04.100091 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.100071 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v4kk8\"" Jul 07 19:08:04.100281 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.100254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.100761 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.100708 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 19:08:04.100761 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.100720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 19:08:04.103741 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.103721 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.104222 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.104204 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.104760 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.104743 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.106093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.105311 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7tkb9\"" Jul 07 19:08:04.110386 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.106704 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.110386 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.107537 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 19:08:04.110386 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.109789 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5sljq\"" Jul 07 19:08:04.110386 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110023 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.110386 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110264 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.110660 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63058447-6fca-4c3f-8991-611b73a03b35-ovn-node-metrics-cert\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.110660 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f69zg\" (UniqueName: \"kubernetes.io/projected/63058447-6fca-4c3f-8991-611b73a03b35-kube-api-access-f69zg\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.110660 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-kubernetes\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-conf\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-systemd\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-slash\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.110774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysconfig\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-lib-modules\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-host\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.110902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-tmp\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111007 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvvt\" (UniqueName: \"kubernetes.io/projected/8c2cd3cf-1f8d-445e-9221-0085607e0e80-kube-api-access-ctvvt\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111007 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-ovn\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111007 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.110987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-script-lib\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111099 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:04.111099 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111172 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-node-log\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111172 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-config\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111247 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111285 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111252 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111330 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-host-slash\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.111364 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111348 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-var-lib-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111394 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-etc-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111423 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-modprobe-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111478 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-iptables-alerter-script\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.111611 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-kubelet\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111611 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-log-socket\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111611 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-bin\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111714 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111623 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111714 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-run\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111714 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-sys\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111800 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjtc\" (UniqueName: \"kubernetes.io/projected/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-kube-api-access-7bjtc\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.111800 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111740 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-netns\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111800 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-systemd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111800 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-env-overrides\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111800 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111787 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-var-lib-kubelet\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-tuned\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.111948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-systemd-units\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.111948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.111894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-netd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.114427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.113836 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.116248 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.116226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.118719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.118250 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 19:08:04.118719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.118514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.118874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.118729 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 19:08:04.118978 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.118962 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vwxl7\"" Jul 07 19:08:04.119034 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.119087 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.119065 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:04.119161 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119145 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.119580 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119532 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7xzxd\"" Jul 07 19:08:04.119683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119668 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.120063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 19:08:04.120063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.119829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.121225 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.121195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.124617 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.123946 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.124853 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.124834 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 19:08:04.124989 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.124972 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 19:08:04.125243 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.125188 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w9s8r\"" Jul 07 19:08:04.126106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.125690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.126106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.126015 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 19:08:04.126441 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.126423 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tqfjj\"" Jul 07 19:08:04.126680 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.126662 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 19:08:04.126885 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.126864 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 19:08:04.127336 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.127317 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 19:08:04.127430 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.127382 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 19:08:04.128083 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.127864 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 19:08:04.128655 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.128641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bpcqm\"" Jul 07 19:08:04.129783 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.128675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.129783 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.129597 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:04.164916 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.164888 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mjj2x" Jul 07 19:08:04.175038 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.174678 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mjj2x" Jul 07 19:08:04.200328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.200309 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 19:08:04.212170 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjtc\" (UniqueName: \"kubernetes.io/projected/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-kube-api-access-7bjtc\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.212274 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-netns\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212274 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-systemd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212274 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-var-lib-kubelet\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212274 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-tuned\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63058447-6fca-4c3f-8991-611b73a03b35-ovn-node-metrics-cert\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-conf\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-systemd\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212385 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-lib-modules\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-host\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cni-binary-copy\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-conf-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212495 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysconfig\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-netns\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-tmp\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212536 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-systemd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d897b9-5540-4563-aeb8-0612ecd44f9f-tmp-dir\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212562 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd48f774-6c3f-4107-8697-62f6885ab890-agent-certs\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-binary-copy\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-var-lib-kubelet\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-ovn\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212635 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-script-lib\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-serviceca\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-socket-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-k8s-cni-cncf-io\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-bin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212741 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-system-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-netns\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.212915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-multus\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212843 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212833 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-sys-fs\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-dbus\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-conf\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-system-cni-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-var-lib-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-systemd\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-modprobe-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-host\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.212994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-device-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-iptables-alerter-script\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-lib-modules\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.213801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-kubelet\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-host\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-run\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-sys\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvz44\" (UniqueName: \"kubernetes.io/projected/97d897b9-5540-4563-aeb8-0612ecd44f9f-kube-api-access-lvz44\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysconfig\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213178 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-env-overrides\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-kubelet\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd48f774-6c3f-4107-8697-62f6885ab890-konnectivity-ca\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-cnibin\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-os-release\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khzf\" (UniqueName: \"kubernetes.io/projected/9595b8b9-615b-42d6-9d19-cfeb31bff432-kube-api-access-7khzf\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213353 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-systemd-units\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213378 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-netd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f69zg\" (UniqueName: \"kubernetes.io/projected/63058447-6fca-4c3f-8991-611b73a03b35-kube-api-access-f69zg\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-kubernetes\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.214709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213438 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-os-release\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213481 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9lbg\" (UniqueName: \"kubernetes.io/projected/ca2e302e-fc61-448e-9234-1d7b557acdcc-kube-api-access-c9lbg\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213508 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-slash\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213545 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvvt\" (UniqueName: \"kubernetes.io/projected/8c2cd3cf-1f8d-445e-9221-0085607e0e80-kube-api-access-ctvvt\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-hostroot\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-env-overrides\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cnibin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-etc-kubernetes\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213668 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-node-log\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-config\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97d897b9-5540-4563-aeb8-0612ecd44f9f-hosts-file\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213781 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-sysctl-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65h4j\" (UniqueName: \"kubernetes.io/projected/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-kube-api-access-65h4j\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213833 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22kv\" (UniqueName: \"kubernetes.io/projected/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-kube-api-access-r22kv\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.215298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-systemd-units\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.213958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-netd\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-host-slash\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-etc-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsnvr\" (UniqueName: \"kubernetes.io/projected/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kube-api-access-nsnvr\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-kubelet-config\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-registration-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-log-socket\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-config\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-bin\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214352 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-socket-dir-parent\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-daemon-config\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.216141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-multus-certs\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-kubernetes\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-slash\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-var-lib-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214594 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-iptables-alerter-script\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-kubelet\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-run\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-sys\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-node-log\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-modprobe-d\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63058447-6fca-4c3f-8991-611b73a03b35-ovnkube-script-lib\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214838 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-etc-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-log-socket\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-ovn\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-run-openvswitch\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214929 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63058447-6fca-4c3f-8991-611b73a03b35-host-cni-bin\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.214963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-host-slash\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.231317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.216587 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-etc-tuned\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.216857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63058447-6fca-4c3f-8991-611b73a03b35-ovn-node-metrics-cert\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.218383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c2cd3cf-1f8d-445e-9221-0085607e0e80-tmp\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.219272 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.219290 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.219299 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.219360 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:04.719342372 +0000 UTC m=+2.937330988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.221648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjtc\" (UniqueName: \"kubernetes.io/projected/cd29b8c6-e916-4752-b2a1-f23fb82f5db8-kube-api-access-7bjtc\") pod \"iptables-alerter-5w8d2\" (UID: \"cd29b8c6-e916-4752-b2a1-f23fb82f5db8\") " pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.222351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f69zg\" (UniqueName: \"kubernetes.io/projected/63058447-6fca-4c3f-8991-611b73a03b35-kube-api-access-f69zg\") pod \"ovnkube-node-qbdvk\" (UID: \"63058447-6fca-4c3f-8991-611b73a03b35\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.222845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvvt\" (UniqueName: \"kubernetes.io/projected/8c2cd3cf-1f8d-445e-9221-0085607e0e80-kube-api-access-ctvvt\") pod \"tuned-x6gtf\" (UID: \"8c2cd3cf-1f8d-445e-9221-0085607e0e80\") " pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.228983 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" event={"ID":"8fe84c148b4beb2400061983cd4783d3","Type":"ContainerStarted","Data":"cdc47a5d8b28a58a897649092ec010e8e60cade2efb177f8a154dbfe471f88a6"} Jul 07 19:08:04.232160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.230281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"384338fb9c8cd805cbb112da5251e876","Type":"ContainerStarted","Data":"f77c8158c535b3dcf0253d81df6437674c32269c4ef7eda5a38c1766c3e07f6d"} Jul 07 19:08:04.315571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315502 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d897b9-5540-4563-aeb8-0612ecd44f9f-tmp-dir\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.315571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd48f774-6c3f-4107-8697-62f6885ab890-agent-certs\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.315571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-binary-copy\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.315775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-serviceca\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.315775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-socket-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.315875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-k8s-cni-cncf-io\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.315875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-bin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.315875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-system-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-netns\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97d897b9-5540-4563-aeb8-0612ecd44f9f-tmp-dir\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-socket-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-multus\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-system-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-netns\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-sys-fs\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-multus\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-dbus\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-system-cni-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316030 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-sys-fs\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-k8s-cni-cncf-io\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-host\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-device-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.315967 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-cni-bin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316118 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvz44\" (UniqueName: \"kubernetes.io/projected/97d897b9-5540-4563-aeb8-0612ecd44f9f-kube-api-access-lvz44\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316089 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-system-cni-dir\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-host\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316140 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-kubelet\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-device-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd48f774-6c3f-4107-8697-62f6885ab890-konnectivity-ca\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-cnibin\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.316483 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-dbus\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-var-lib-kubelet\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-os-release\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316200 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-serviceca\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khzf\" (UniqueName: \"kubernetes.io/projected/9595b8b9-615b-42d6-9d19-cfeb31bff432-kube-api-access-7khzf\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-cnibin\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-os-release\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316296 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9595b8b9-615b-42d6-9d19-cfeb31bff432-os-release\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9lbg\" (UniqueName: \"kubernetes.io/projected/ca2e302e-fc61-448e-9234-1d7b557acdcc-kube-api-access-c9lbg\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-hostroot\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-os-release\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316368 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316381 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-hostroot\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316390 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cnibin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cnibin\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-etc-kubernetes\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97d897b9-5540-4563-aeb8-0612ecd44f9f-hosts-file\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.317470 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.316545 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65h4j\" (UniqueName: \"kubernetes.io/projected/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-kube-api-access-65h4j\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22kv\" (UniqueName: \"kubernetes.io/projected/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-kube-api-access-r22kv\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97d897b9-5540-4563-aeb8-0612ecd44f9f-hosts-file\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.316641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:04.816620569 +0000 UTC m=+3.034609202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.316662 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd48f774-6c3f-4107-8697-62f6885ab890-konnectivity-ca\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316703 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsnvr\" (UniqueName: \"kubernetes.io/projected/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kube-api-access-nsnvr\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.316721 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:04.816706856 +0000 UTC m=+3.034695493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316727 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-binary-copy\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-kubelet-config\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-registration-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316840 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-socket-dir-parent\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-daemon-config\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316884 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-etc-selinux\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22985704-9f1c-47ed-a6a9-58e6447b2ea0-kubelet-config\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-etc-kubernetes\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-multus-certs\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316962 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-socket-dir-parent\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316958 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-registration-dir\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cni-binary-copy\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317018 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-cni-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-conf-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.316922 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-host-run-multus-certs\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-conf-dir\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9595b8b9-615b-42d6-9d19-cfeb31bff432-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-multus-daemon-config\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.317496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-cni-binary-copy\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.318952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.318690 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd48f774-6c3f-4107-8697-62f6885ab890-agent-certs\") pod \"konnectivity-agent-pm6nf\" (UID: \"fd48f774-6c3f-4107-8697-62f6885ab890\") " pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.326399 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.326378 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khzf\" (UniqueName: \"kubernetes.io/projected/9595b8b9-615b-42d6-9d19-cfeb31bff432-kube-api-access-7khzf\") pod \"multus-additional-cni-plugins-t449w\" (UID: \"9595b8b9-615b-42d6-9d19-cfeb31bff432\") " pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.329384 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.329367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsnvr\" (UniqueName: \"kubernetes.io/projected/f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c-kube-api-access-nsnvr\") pod \"aws-ebs-csi-driver-node-lmkn8\" (UID: \"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.329748 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.329730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvz44\" (UniqueName: \"kubernetes.io/projected/97d897b9-5540-4563-aeb8-0612ecd44f9f-kube-api-access-lvz44\") pod \"node-resolver-b6dj2\" (UID: \"97d897b9-5540-4563-aeb8-0612ecd44f9f\") " pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.329748 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.329744 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22kv\" (UniqueName: \"kubernetes.io/projected/bc8a67a8-5764-4c8a-bd21-d74c72b4cf09-kube-api-access-r22kv\") pod \"multus-x7lwf\" (UID: \"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09\") " pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.329899 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.329879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9lbg\" (UniqueName: \"kubernetes.io/projected/ca2e302e-fc61-448e-9234-1d7b557acdcc-kube-api-access-c9lbg\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.332549 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.332532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65h4j\" (UniqueName: \"kubernetes.io/projected/2dd7d4f5-0d21-426f-ae8e-c6d933f275a5-kube-api-access-65h4j\") pod \"node-ca-scl5n\" (UID: \"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5\") " pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.418776 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.418748 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5w8d2" Jul 07 19:08:04.428157 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.428136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" Jul 07 19:08:04.443855 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.443832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:04.451413 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.451393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6dj2" Jul 07 19:08:04.463240 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.463206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-scl5n" Jul 07 19:08:04.471876 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.471854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" Jul 07 19:08:04.479385 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.479367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:04.489958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.489939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t449w" Jul 07 19:08:04.495567 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.495549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x7lwf" Jul 07 19:08:04.719531 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.719507 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 19:08:04.820372 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.820338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:04.820559 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.820387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:04.820559 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:04.820438 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:04.820559 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820507 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820570 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:05.820550634 +0000 UTC m=+4.038539259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820575 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820590 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820606 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820619 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820649 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:05.820631173 +0000 UTC m=+4.038619810 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:04.820715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:04.820670 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:05.820659673 +0000 UTC m=+4.038648290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:05.178815 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.178726 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:03:04 +0000 UTC" deadline="2028-01-04 14:31:44.457846529 +0000 UTC" Jul 07 19:08:05.178815 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.178767 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13099h23m39.279081885s" Jul 07 19:08:05.224306 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.224270 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:05.224306 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.224311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:05.224550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.224381 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:05.224550 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.224402 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:05.224550 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.224510 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:05.224671 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.224605 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:05.368209 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.368158 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd7d4f5_0d21_426f_ae8e_c6d933f275a5.slice/crio-368ae5f9182ecfefc82ce41060c41e864b4836c75ad82267f66a2dc23e189498 WatchSource:0}: Error finding container 368ae5f9182ecfefc82ce41060c41e864b4836c75ad82267f66a2dc23e189498: Status 404 returned error can't find the container with id 368ae5f9182ecfefc82ce41060c41e864b4836c75ad82267f66a2dc23e189498 Jul 07 19:08:05.369724 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.369580 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97d897b9_5540_4563_aeb8_0612ecd44f9f.slice/crio-3fbe8acdc163d64d630892252bed6763b16d0fa08161ed2b0d804ed46b59c546 WatchSource:0}: Error finding container 3fbe8acdc163d64d630892252bed6763b16d0fa08161ed2b0d804ed46b59c546: Status 404 returned error can't find the container with id 3fbe8acdc163d64d630892252bed6763b16d0fa08161ed2b0d804ed46b59c546 Jul 07 19:08:05.375961 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.375291 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2cd3cf_1f8d_445e_9221_0085607e0e80.slice/crio-aa0b9d61679b3813134a7240614b630ce6fd9918681544ded5fb9c23993d1918 WatchSource:0}: Error finding container aa0b9d61679b3813134a7240614b630ce6fd9918681544ded5fb9c23993d1918: Status 404 returned error can't find the container with id aa0b9d61679b3813134a7240614b630ce6fd9918681544ded5fb9c23993d1918 Jul 07 19:08:05.376282 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.376261 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c3f8af_100f_4b93_9ca6_42e9c9e5a54c.slice/crio-9f2b3f3933ca280140e3086b9346088c761edf0842d90e8079f551812679185c WatchSource:0}: Error finding container 9f2b3f3933ca280140e3086b9346088c761edf0842d90e8079f551812679185c: Status 404 returned error can't find the container with id 9f2b3f3933ca280140e3086b9346088c761edf0842d90e8079f551812679185c Jul 07 19:08:05.376896 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.376876 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd29b8c6_e916_4752_b2a1_f23fb82f5db8.slice/crio-9382f0bf6d088bdcfe0d54bc9526ec92fea6098a62e5ddb50cb5dedc90c954eb WatchSource:0}: Error finding container 9382f0bf6d088bdcfe0d54bc9526ec92fea6098a62e5ddb50cb5dedc90c954eb: Status 404 returned error can't find the container with id 9382f0bf6d088bdcfe0d54bc9526ec92fea6098a62e5ddb50cb5dedc90c954eb Jul 07 19:08:05.378152 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.378131 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd48f774_6c3f_4107_8697_62f6885ab890.slice/crio-9354d99465d9c3984f0f6c2431ca25a43d0f559ee4aae94249fd418171d5b27f WatchSource:0}: Error finding container 9354d99465d9c3984f0f6c2431ca25a43d0f559ee4aae94249fd418171d5b27f: Status 404 returned error can't find the container with id 9354d99465d9c3984f0f6c2431ca25a43d0f559ee4aae94249fd418171d5b27f Jul 07 19:08:05.379278 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.379256 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63058447_6fca_4c3f_8991_611b73a03b35.slice/crio-fffbb8c133a183ba2a18b672e535f0cd2ca47fe2dbe835b42660329fc3cb8fba WatchSource:0}: Error finding container fffbb8c133a183ba2a18b672e535f0cd2ca47fe2dbe835b42660329fc3cb8fba: Status 404 returned error can't find the container with id fffbb8c133a183ba2a18b672e535f0cd2ca47fe2dbe835b42660329fc3cb8fba Jul 07 19:08:05.380964 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.380944 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8a67a8_5764_4c8a_bd21_d74c72b4cf09.slice/crio-47678d6a106dcee0c2b019f345204defe862903cc5e5261dec9a9963eed04fba WatchSource:0}: Error finding container 47678d6a106dcee0c2b019f345204defe862903cc5e5261dec9a9963eed04fba: Status 404 returned error can't find the container with id 47678d6a106dcee0c2b019f345204defe862903cc5e5261dec9a9963eed04fba Jul 07 19:08:05.383521 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:05.382932 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9595b8b9_615b_42d6_9d19_cfeb31bff432.slice/crio-301aad3fc561f64c96efc1f67f8d313f930941a3ea4cfbfea64b28e55e2b1e8c WatchSource:0}: Error finding container 301aad3fc561f64c96efc1f67f8d313f930941a3ea4cfbfea64b28e55e2b1e8c: Status 404 returned error can't find the container with id 301aad3fc561f64c96efc1f67f8d313f930941a3ea4cfbfea64b28e55e2b1e8c Jul 07 19:08:05.828535 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.828215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.828541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828439 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828597 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828617 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:05.828617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:05.828698 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:07.828669396 +0000 UTC m=+6.046658035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:05.829000 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828724 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:05.829000 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828776 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:07.828759688 +0000 UTC m=+6.046748324 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:05.829000 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828829 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:05.829000 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:05.828858 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:07.828848374 +0000 UTC m=+6.046836989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:06.179706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.179625 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 19:03:04 +0000 UTC" deadline="2028-02-25 17:27:02.480508253 +0000 UTC" Jul 07 19:08:06.179706 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.179665 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14350h18m56.300848373s" Jul 07 19:08:06.248915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.248816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5w8d2" event={"ID":"cd29b8c6-e916-4752-b2a1-f23fb82f5db8","Type":"ContainerStarted","Data":"9382f0bf6d088bdcfe0d54bc9526ec92fea6098a62e5ddb50cb5dedc90c954eb"} Jul 07 19:08:06.269322 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.269259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" event={"ID":"8c2cd3cf-1f8d-445e-9221-0085607e0e80","Type":"ContainerStarted","Data":"aa0b9d61679b3813134a7240614b630ce6fd9918681544ded5fb9c23993d1918"} Jul 07 19:08:06.275365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.275264 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6dj2" event={"ID":"97d897b9-5540-4563-aeb8-0612ecd44f9f","Type":"ContainerStarted","Data":"3fbe8acdc163d64d630892252bed6763b16d0fa08161ed2b0d804ed46b59c546"} Jul 07 19:08:06.279171 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.279100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-scl5n" event={"ID":"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5","Type":"ContainerStarted","Data":"368ae5f9182ecfefc82ce41060c41e864b4836c75ad82267f66a2dc23e189498"} Jul 07 19:08:06.301496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.300854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" event={"ID":"8fe84c148b4beb2400061983cd4783d3","Type":"ContainerStarted","Data":"188ccb2e4e6cae163f9426f37aef5833149be87b2aa0673c63782337cd903444"} Jul 07 19:08:06.312473 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.312422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerStarted","Data":"301aad3fc561f64c96efc1f67f8d313f930941a3ea4cfbfea64b28e55e2b1e8c"} Jul 07 19:08:06.317823 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.317772 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" podStartSLOduration=3.317754094 podStartE2EDuration="3.317754094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:06.31760286 +0000 UTC m=+4.535591499" watchObservedRunningTime="2026-07-07 19:08:06.317754094 +0000 UTC m=+4.535742740" Jul 07 19:08:06.325224 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.325198 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"fffbb8c133a183ba2a18b672e535f0cd2ca47fe2dbe835b42660329fc3cb8fba"} Jul 07 19:08:06.328185 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.328161 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" event={"ID":"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c","Type":"ContainerStarted","Data":"9f2b3f3933ca280140e3086b9346088c761edf0842d90e8079f551812679185c"} Jul 07 19:08:06.332256 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.332231 2576 generic.go:356] "Generic (PLEG): container finished" podID="384338fb9c8cd805cbb112da5251e876" containerID="70c5ac1909abecf4bc6b44f04171b49f057f9a0154a0a6307933a8ea39b1950e" exitCode=0 Jul 07 19:08:06.332349 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.332303 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"384338fb9c8cd805cbb112da5251e876","Type":"ContainerDied","Data":"70c5ac1909abecf4bc6b44f04171b49f057f9a0154a0a6307933a8ea39b1950e"} Jul 07 19:08:06.336898 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.336874 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x7lwf" event={"ID":"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09","Type":"ContainerStarted","Data":"47678d6a106dcee0c2b019f345204defe862903cc5e5261dec9a9963eed04fba"} Jul 07 19:08:06.347946 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:06.347921 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pm6nf" event={"ID":"fd48f774-6c3f-4107-8697-62f6885ab890","Type":"ContainerStarted","Data":"9354d99465d9c3984f0f6c2431ca25a43d0f559ee4aae94249fd418171d5b27f"} Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.224428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.224577 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.225084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.225205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.225265 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:07.225382 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.225340 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:07.366652 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.366618 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"384338fb9c8cd805cbb112da5251e876","Type":"ContainerStarted","Data":"7221d6be021516190313c8cff41f076ae2cbd5e1c0214065be35ae5ec8322517"} Jul 07 19:08:07.840969 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.840933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:07.841120 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.840991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:07.841120 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:07.841046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:07.841264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841199 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:07.841264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841219 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:07.841264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841231 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:07.841401 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841286 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:11.841268334 +0000 UTC m=+10.059256951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:07.842337 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841681 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:07.842337 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841732 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:11.841716601 +0000 UTC m=+10.059705218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:07.842337 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841792 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:07.842337 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:07.841821 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:11.841811059 +0000 UTC m=+10.059799676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:09.223854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:09.223820 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:09.224233 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:09.223952 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:09.224281 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:09.224237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:09.224310 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:09.224299 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:09.224369 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:09.224347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:09.228136 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:09.224872 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.224733 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.224757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.224743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.224883 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.225013 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:11.225232 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.225095 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:11.874707 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.874679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.874721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:11.874764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874858 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874857 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874876 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:11.874906 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874888 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:11.875189 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874857 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:11.875189 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874930 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:19.874910513 +0000 UTC m=+18.092899143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:11.875189 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874949 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:19.874937053 +0000 UTC m=+18.092925671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:11.875189 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:11.874967 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:19.874957116 +0000 UTC m=+18.092945730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:13.224005 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:13.223920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:13.224437 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:13.224046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:13.224521 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:13.224476 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:13.224600 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:13.224574 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:13.224730 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:13.224631 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:13.224730 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:13.224716 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:15.224598 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:15.224566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:15.225135 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:15.224699 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:15.225135 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:15.225087 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:15.225260 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:15.225178 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:15.225260 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:15.225215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:15.225260 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:15.225256 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:17.224279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:17.224331 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:17.224408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:17.224421 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:17.224530 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:17.224828 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:17.224614 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:19.224205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.224174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:19.224205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.224204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:19.224699 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.224295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:19.224699 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.224290 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:19.224699 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.224422 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:19.224699 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.224523 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:19.935860 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.935820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:19.936045 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.935891 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:19.936045 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:19.935938 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:19.936045 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.935985 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:19.936045 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936010 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:19.936045 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:35.9360267 +0000 UTC m=+34.154015337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:19.936263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936063 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:35.936053343 +0000 UTC m=+34.154041961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:19.936263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936110 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:19.936263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936127 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:19.936263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936139 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:19.936263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:19.936170 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:08:35.936160534 +0000 UTC m=+34.154149157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:21.223898 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:21.223865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:21.224324 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:21.223865 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:21.224324 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:21.223976 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:21.224324 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:21.224088 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:21.224324 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:21.223868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:21.224324 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:21.224211 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:23.224213 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:23.224172 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:23.224213 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:23.224201 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:23.224695 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:23.224292 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:23.224695 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:23.224307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:23.224695 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:23.224366 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:23.224695 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:23.224447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:24.416961 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.416508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"d754c90b16aaeed3a8725d9a9d52aa6d27379cd97e88224275d5a5931676fcdb"} Jul 07 19:08:24.418216 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.418189 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" event={"ID":"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c","Type":"ContainerStarted","Data":"a68658c709d40b87eb424992764aa744e55375c3d01ef75fbf9eb47380b46391"} Jul 07 19:08:24.419666 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.419642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x7lwf" event={"ID":"bc8a67a8-5764-4c8a-bd21-d74c72b4cf09","Type":"ContainerStarted","Data":"c0c24d76fb2c4ce07653e3147024ad9f0af7fc8340420bf0b86371d8da04ea15"} Jul 07 19:08:24.422546 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.422518 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pm6nf" event={"ID":"fd48f774-6c3f-4107-8697-62f6885ab890","Type":"ContainerStarted","Data":"7609000dd17a62ddaa4336151e017b3e6dfdaac8f8e888c689463d709bfa7413"} Jul 07 19:08:24.424903 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.424050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" event={"ID":"8c2cd3cf-1f8d-445e-9221-0085607e0e80","Type":"ContainerStarted","Data":"fed831e7d0483e14f33e9c2b77666e7242a106b53a34c3405fd10d5ac48716d5"} Jul 07 19:08:24.425927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.425905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6dj2" event={"ID":"97d897b9-5540-4563-aeb8-0612ecd44f9f","Type":"ContainerStarted","Data":"d4671d93a8026431de78d220dc08f65185b29d8a930f240e29389c9d086bddfe"} Jul 07 19:08:24.427537 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.427508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-scl5n" event={"ID":"2dd7d4f5-0d21-426f-ae8e-c6d933f275a5","Type":"ContainerStarted","Data":"1e59d610e5fc6d29ffa71d07d3c6a3a8070a211ce6cb472a054cdfce66e1626f"} Jul 07 19:08:24.444242 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.443987 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" podStartSLOduration=21.443969014 podStartE2EDuration="21.443969014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:07.384499468 +0000 UTC m=+5.602488136" watchObservedRunningTime="2026-07-07 19:08:24.443969014 +0000 UTC m=+22.661957653" Jul 07 19:08:24.444341 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.444230 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x7lwf" podStartSLOduration=3.572662647 podStartE2EDuration="22.444220786s" totalImagesPullingTime="18.871558139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:24.443383392 +0000 UTC m=+22.661372030" watchObservedRunningTime="2026-07-07 19:08:24.444220786 +0000 UTC m=+22.662209427" Jul 07 19:08:24.460489 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.460032 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pm6nf" podStartSLOduration=11.987432167 podStartE2EDuration="22.460013243s" totalImagesPullingTime="10.472581076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:24.459884391 +0000 UTC m=+22.677873028" watchObservedRunningTime="2026-07-07 19:08:24.460013243 +0000 UTC m=+22.678001884" Jul 07 19:08:24.479298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.479243 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x6gtf" podStartSLOduration=3.6627690040000003 podStartE2EDuration="22.479227264s" totalImagesPullingTime="18.81645826s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:24.478664385 +0000 UTC m=+22.696653021" watchObservedRunningTime="2026-07-07 19:08:24.479227264 +0000 UTC m=+22.697215908" Jul 07 19:08:24.496156 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.496104 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-scl5n" podStartSLOduration=12.047016132 podStartE2EDuration="22.496089115s" totalImagesPullingTime="10.449072983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:24.4956801 +0000 UTC m=+22.713668757" watchObservedRunningTime="2026-07-07 19:08:24.496089115 +0000 UTC m=+22.714077751" Jul 07 19:08:24.514732 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:24.514691 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b6dj2" podStartSLOduration=12.032698853 podStartE2EDuration="22.514678505s" totalImagesPullingTime="10.481979652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:24.514407787 +0000 UTC m=+22.732396423" watchObservedRunningTime="2026-07-07 19:08:24.514678505 +0000 UTC m=+22.732667140" Jul 07 19:08:25.224605 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.224577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:25.224754 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.224611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:25.224754 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.224577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:25.224754 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:25.224665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:25.224856 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:25.224753 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:25.224856 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:25.224813 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:25.420634 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.420611 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:25.421685 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.421665 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:25.430963 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.430932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5w8d2" event={"ID":"cd29b8c6-e916-4752-b2a1-f23fb82f5db8","Type":"ContainerStarted","Data":"056ebabdb777166ffad0629c133d9bd50c59f775299a939138c9b7c4128ef3bc"} Jul 07 19:08:25.432738 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.432711 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="e291104a7432639bec38d0e0bace9548165d0dbf8f5727cf7f1f2b60b229f8b4" exitCode=0 Jul 07 19:08:25.432853 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.432796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"e291104a7432639bec38d0e0bace9548165d0dbf8f5727cf7f1f2b60b229f8b4"} Jul 07 19:08:25.436367 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.436339 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"b938c2814b194f227871a2fa2b882a286e2b6235cdb785e34bc4b79b868dfeb9"} Jul 07 19:08:25.436494 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.436424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"0be850b118fb30255fd50608bda95af9ad0ccf5cfbd0fae73c88b9409e297924"} Jul 07 19:08:25.436494 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.436490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"d53bc32edbb608842b060215cfa4c2914630cdbe779ff106934b648f1fa8fd96"} Jul 07 19:08:25.436605 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.436539 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"e23d68e1818d672788da78b164ea471e51d10d7cf14d5dd01d00f175dd51895a"} Jul 07 19:08:25.436605 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.436568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"6961689a5917dd813492283dc4f0096d0e8abcdfc15bd94ac01e6d15c7ba180a"} Jul 07 19:08:25.455926 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:25.455888 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5w8d2" podStartSLOduration=12.976408885 podStartE2EDuration="23.45587376s" totalImagesPullingTime="10.479464875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:25.455596463 +0000 UTC m=+23.673585099" watchObservedRunningTime="2026-07-07 19:08:25.45587376 +0000 UTC m=+23.673862396" Jul 07 19:08:26.214918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:26.214885 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 19:08:26.317067 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:26.317026 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:26.317783 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:26.317759 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pm6nf" Jul 07 19:08:26.440474 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:26.440427 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" event={"ID":"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c","Type":"ContainerStarted","Data":"588f7a7a6fd3845c6aa70d12a790f9df324693d5ab6da8e622ac6c0fa3da107f"} Jul 07 19:08:27.180098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.180012 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T19:08:26.21490871Z","UUID":"8afc9760-6b9d-4ee4-a6e7-008e22d07408","Handler":null,"Name":"","Endpoint":""} Jul 07 19:08:27.181559 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.181535 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 19:08:27.181698 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.181584 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.224636 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.224639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.224680 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:27.224766 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:27.224871 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:27.225075 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:27.224960 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:27.446489 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:27.446436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"24d8ee8a59f4a31a91abe4e041350e2a30626ed479809441667c5a93f9fbec2d"} Jul 07 19:08:28.450981 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:28.450769 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" event={"ID":"f6c3f8af-100f-4b93-9ca6-42e9c9e5a54c","Type":"ContainerStarted","Data":"90f0088af84b422d0b2c6753f48f424b6c0d00dd744aa8785e207d6d98bd3135"} Jul 07 19:08:28.472348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:28.472296 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lmkn8" podStartSLOduration=12.963058587999999 podStartE2EDuration="26.472278907s" totalImagesPullingTime="13.509220319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:28.471756879 +0000 UTC m=+26.689745515" watchObservedRunningTime="2026-07-07 19:08:28.472278907 +0000 UTC m=+26.690267543" Jul 07 19:08:29.224398 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:29.224373 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:29.224536 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:29.224519 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:29.224584 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:29.224527 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:29.224584 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:29.224549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:29.224674 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:29.224653 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:29.224756 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:29.224741 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:29.457631 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:29.457594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" event={"ID":"63058447-6fca-4c3f-8991-611b73a03b35","Type":"ContainerStarted","Data":"6d5f38006b03f10b5a6dc7fb8e25596c65f4c9d6c2b4aa7c3d029e94813bdc6c"} Jul 07 19:08:29.493824 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:29.493774 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" podStartSLOduration=8.612569365 podStartE2EDuration="27.493760895s" totalImagesPullingTime="18.88119153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:29.492240645 +0000 UTC m=+27.710229281" watchObservedRunningTime="2026-07-07 19:08:29.493760895 +0000 UTC m=+27.711749530" Jul 07 19:08:30.461083 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:30.460705 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:30.461083 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:30.460960 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:30.461083 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:30.461019 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:30.479443 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:30.479412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:30.480295 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:30.480267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:08:31.224618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.224584 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:31.224618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.224590 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:31.224847 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.224695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:31.224847 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.224751 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:31.224847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.224802 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:31.224995 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.224900 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:31.554150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.554072 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgjzx"] Jul 07 19:08:31.554522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.554212 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:31.554522 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.554304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:31.560399 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.560373 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8sb6h"] Jul 07 19:08:31.560532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.560443 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:31.560579 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.560529 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:31.572340 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.572303 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbt5n"] Jul 07 19:08:31.572486 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:31.572361 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:31.572486 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:31.572418 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:32.465567 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:32.465529 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="71c4efa5e38ea9e2abc98c80e8e76c1523a11eefea102419b69b8169e50d2461" exitCode=0 Jul 07 19:08:32.465768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:32.465612 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"71c4efa5e38ea9e2abc98c80e8e76c1523a11eefea102419b69b8169e50d2461"} Jul 07 19:08:33.224540 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:33.224508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:33.224902 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:33.224645 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:33.224902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:33.224727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:33.224902 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:33.224814 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:33.224902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:33.224868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:33.225109 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:33.224930 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:33.470068 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:33.469996 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="8a0870903615672964e7b8e5d5b92814e772dd7b81565b738d89374ab3eaede4" exitCode=0 Jul 07 19:08:33.470068 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:33.470058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"8a0870903615672964e7b8e5d5b92814e772dd7b81565b738d89374ab3eaede4"} Jul 07 19:08:34.475156 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:34.475121 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="6d08f18393ad9d56e0ad8946f2bec6cd7ba5d31222d77a3a2c15b62f4d73ef99" exitCode=0 Jul 07 19:08:34.475542 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:34.475175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"6d08f18393ad9d56e0ad8946f2bec6cd7ba5d31222d77a3a2c15b62f4d73ef99"} Jul 07 19:08:35.224654 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.224575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:35.224654 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.224630 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:35.224820 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.224639 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:35.224820 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.224718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bbt5n" podUID="9d144ea6-3bfa-4da4-a21a-24df1be46adc" Jul 07 19:08:35.224820 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.224785 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8sb6h" podUID="ca2e302e-fc61-448e-9234-1d7b557acdcc" Jul 07 19:08:35.224929 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.224846 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgjzx" podUID="22985704-9f1c-47ed-a6a9-58e6447b2ea0" Jul 07 19:08:35.957730 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.957697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.957750 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:35.957771 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957866 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957866 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957892 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957916 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957928 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs podName:ca2e302e-fc61-448e-9234-1d7b557acdcc nodeName:}" failed. No retries permitted until 2026-07-07 19:09:07.957909555 +0000 UTC m=+66.175898169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs") pod "network-metrics-daemon-8sb6h" (UID: "ca2e302e-fc61-448e-9234-1d7b557acdcc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957928 2576 projected.go:196] Error preparing data for projected volume kube-api-access-7pt5v for pod openshift-network-diagnostics/network-check-target-bbt5n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret podName:22985704-9f1c-47ed-a6a9-58e6447b2ea0 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:07.957936067 +0000 UTC m=+66.175924682 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret") pod "global-pull-secret-syncer-bgjzx" (UID: "22985704-9f1c-47ed-a6a9-58e6447b2ea0") : object "kube-system"/"original-pull-secret" not registered Jul 07 19:08:35.958275 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:35.957998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v podName:9d144ea6-3bfa-4da4-a21a-24df1be46adc nodeName:}" failed. No retries permitted until 2026-07-07 19:09:07.957982565 +0000 UTC m=+66.175971191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pt5v" (UniqueName: "kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v") pod "network-check-target-bbt5n" (UID: "9d144ea6-3bfa-4da4-a21a-24df1be46adc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 19:08:37.089349 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.089280 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeReady" Jul 07 19:08:37.089785 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.089408 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 19:08:37.123848 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.123817 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:08:37.127271 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.127254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.129758 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.129729 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 19:08:37.129758 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.129742 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82tfj\"" Jul 07 19:08:37.129951 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.129810 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 19:08:37.129951 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.129737 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 19:08:37.135085 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.135057 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 19:08:37.139253 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.139230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f7rzd"] Jul 07 19:08:37.142992 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.142971 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:08:37.143090 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.143071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.144484 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.143759 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qqrjk"] Jul 07 19:08:37.146108 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.145773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 19:08:37.146108 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.145832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42k7f\"" Jul 07 19:08:37.146108 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.146005 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 19:08:37.147003 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.146983 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.149368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.149347 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jbcxp\"" Jul 07 19:08:37.149582 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.149567 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 19:08:37.149756 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.149741 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 19:08:37.150054 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.150038 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 19:08:37.156573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.156551 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7rzd"] Jul 07 19:08:37.157995 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.157974 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qqrjk"] Jul 07 19:08:37.224082 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.224059 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:08:37.224082 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.224084 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:08:37.224225 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.224083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:08:37.226854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.226832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 19:08:37.226969 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.226853 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 19:08:37.226969 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.226934 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7q8zk\"" Jul 07 19:08:37.227074 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.227017 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 19:08:37.227116 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.227095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 19:08:37.227164 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.227151 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xjkd\"" Jul 07 19:08:37.268888 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.268862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c71552c-07ac-49be-8d09-5273c6090945-config-volume\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.269003 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.268919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtrj7\" (UniqueName: \"kubernetes.io/projected/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-kube-api-access-dtrj7\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.269003 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.268952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpdrf\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269003 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.268979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-cert\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.269149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tz9j\" (UniqueName: \"kubernetes.io/projected/2c71552c-07ac-49be-8d09-5273c6090945-kube-api-access-6tz9j\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.269149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.269302 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269302 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269198 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c71552c-07ac-49be-8d09-5273c6090945-tmp-dir\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.269302 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269302 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269463 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.269463 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.269333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370231 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370231 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c71552c-07ac-49be-8d09-5273c6090945-config-volume\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtrj7\" (UniqueName: \"kubernetes.io/projected/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-kube-api-access-dtrj7\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpdrf\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370323 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-cert\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tz9j\" (UniqueName: \"kubernetes.io/projected/2c71552c-07ac-49be-8d09-5273c6090945-kube-api-access-6tz9j\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.370797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.370797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c71552c-07ac-49be-8d09-5273c6090945-tmp-dir\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.370797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.370797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.371015 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.370802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2c71552c-07ac-49be-8d09-5273c6090945-config-volume\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.371069 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.371037 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:37.371115 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.371071 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:37.371115 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.371094 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:37.371115 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.371109 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:37.871090002 +0000 UTC m=+36.089078629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:37.371258 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.371162 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:37.871142831 +0000 UTC m=+36.089131465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:37.371432 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.371408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c71552c-07ac-49be-8d09-5273c6090945-tmp-dir\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.371527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.371474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.371591 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.371567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.371894 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.371873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.375304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.375283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.375390 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.375301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.375390 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.375285 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-cert\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.379977 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.379951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tz9j\" (UniqueName: \"kubernetes.io/projected/2c71552c-07ac-49be-8d09-5273c6090945-kube-api-access-6tz9j\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.380078 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.379987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpdrf\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.380318 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.380297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.380430 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.380411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtrj7\" (UniqueName: \"kubernetes.io/projected/e1da7afd-36dc-4e42-bb9e-fba66fbce76c-kube-api-access-dtrj7\") pod \"ingress-canary-qqrjk\" (UID: \"e1da7afd-36dc-4e42-bb9e-fba66fbce76c\") " pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.463550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.463514 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qqrjk" Jul 07 19:08:37.874072 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.874035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:37.874130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.874219 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.874238 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.874249 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.874302 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:38.874282614 +0000 UTC m=+37.092271242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:37.874343 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:37.874320 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:38.874311227 +0000 UTC m=+37.092299847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:38.589230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.589199 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2"] Jul 07 19:08:38.619897 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.619860 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2"] Jul 07 19:08:38.620049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.619967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.624190 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.624167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.624305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.624218 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 19:08:38.624305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.624244 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.625497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.625467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nds49\"" Jul 07 19:08:38.636503 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.636485 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 19:08:38.703985 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.703956 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xxw5w"] Jul 07 19:08:38.719823 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.719792 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.721599 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.721574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xxw5w"] Jul 07 19:08:38.722570 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.722548 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 19:08:38.722661 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.722596 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.722873 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.722856 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wmwx5\"" Jul 07 19:08:38.722948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.722911 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.722990 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.722942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 19:08:38.727574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.727554 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7"] Jul 07 19:08:38.738049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.737650 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 19:08:38.748540 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.748517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7"] Jul 07 19:08:38.748622 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.748596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" Jul 07 19:08:38.751602 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.751580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r75rt\"" Jul 07 19:08:38.752772 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.752756 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.752872 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.752785 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.781052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.781024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.781238 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.781175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp4v8\" (UniqueName: \"kubernetes.io/projected/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-kube-api-access-vp4v8\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.781238 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.781217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.790865 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.790846 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v"] Jul 07 19:08:38.795230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.795212 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88"] Jul 07 19:08:38.795336 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.795322 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" Jul 07 19:08:38.798400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.798377 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-w5mf5\"" Jul 07 19:08:38.801531 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.801497 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7"] Jul 07 19:08:38.801803 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.801773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.804535 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.804516 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.804655 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.804622 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.804724 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.804709 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 07 19:08:38.806687 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.805499 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 07 19:08:38.806687 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.805519 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-skmht\"" Jul 07 19:08:38.811724 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.811705 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt"] Jul 07 19:08:38.813014 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.812988 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.816843 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.815970 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c6559656f-x5jgr"] Jul 07 19:08:38.816843 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.816313 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:38.816843 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.816723 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.817124 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.817087 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.817363 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.817302 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 07 19:08:38.817363 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.817342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jvmmm\"" Jul 07 19:08:38.817641 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.817521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 07 19:08:38.819412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.819394 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h22ch\"" Jul 07 19:08:38.819650 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.819572 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 19:08:38.819754 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.819740 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.820128 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.820108 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.824780 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.824762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v"] Jul 07 19:08:38.824875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.824798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88"] Jul 07 19:08:38.824875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.824814 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7"] Jul 07 19:08:38.824875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.824831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt"] Jul 07 19:08:38.825031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.824878 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.827993 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.827975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 19:08:38.828094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828033 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 19:08:38.828150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828128 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.828235 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828219 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 19:08:38.828502 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828481 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 19:08:38.828589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828481 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.828662 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.828602 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-24cc5\"" Jul 07 19:08:38.832807 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.832770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6559656f-x5jgr"] Jul 07 19:08:38.882067 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.881892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-tmp\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882207 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:38.882207 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882111 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a44d41-3868-4838-974c-1787e8cb72a5-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.882207 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m96xn\" (UniqueName: \"kubernetes.io/projected/41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb-kube-api-access-m96xn\") pod \"network-check-source-989f8b8dc-mlj2v\" (UID: \"41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" Jul 07 19:08:38.882207 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-config\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882228 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882342 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsm8s\" (UniqueName: \"kubernetes.io/projected/c85eee24-fa6f-4f07-b4dc-31da091b7218-kube-api-access-fsm8s\") pod \"volume-data-source-validator-5d456fdbcd-hn6p7\" (UID: \"c85eee24-fa6f-4f07-b4dc-31da091b7218\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882354 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882356 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.882339984 +0000 UTC m=+39.100328597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:38.882428 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.882401182 +0000 UTC m=+39.100389800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/153b3d70-310e-4e2f-93e4-d9644d890f76-serving-cert\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a44d41-3868-4838-974c-1787e8cb72a5-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrp9s\" (UniqueName: \"kubernetes.io/projected/153b3d70-310e-4e2f-93e4-d9644d890f76-kube-api-access-hrp9s\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-snapshots\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6lvn\" (UniqueName: \"kubernetes.io/projected/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-kube-api-access-c6lvn\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qpc\" (UniqueName: \"kubernetes.io/projected/b5a44d41-3868-4838-974c-1787e8cb72a5-kube-api-access-h5qpc\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.882794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp4v8\" (UniqueName: \"kubernetes.io/projected/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-kube-api-access-vp4v8\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882806 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:38.882870 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:38.882840 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:08:39.382826683 +0000 UTC m=+37.600815296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:38.883520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.883158 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.890368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.890345 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xwwdx"] Jul 07 19:08:38.898128 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.898105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp4v8\" (UniqueName: \"kubernetes.io/projected/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-kube-api-access-vp4v8\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:38.904086 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.904067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:38.906857 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.906836 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xwwdx"] Jul 07 19:08:38.907190 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.907156 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 19:08:38.907190 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.907159 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:08:38.907353 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.907336 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wp8k9\"" Jul 07 19:08:38.907490 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.907475 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 19:08:38.907742 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.907716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 19:08:38.915398 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.915362 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 19:08:38.919897 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.919878 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qqrjk"] Jul 07 19:08:38.922985 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:38.922965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1da7afd_36dc_4e42_bb9e_fba66fbce76c.slice/crio-74c17ac7bd7cc5174e9dc74dd6dbbda07ea11e6490233230aeb8bde93df7f756 WatchSource:0}: Error finding container 74c17ac7bd7cc5174e9dc74dd6dbbda07ea11e6490233230aeb8bde93df7f756: Status 404 returned error can't find the container with id 74c17ac7bd7cc5174e9dc74dd6dbbda07ea11e6490233230aeb8bde93df7f756 Jul 07 19:08:38.983475 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.983436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.983661 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.983642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsm8s\" (UniqueName: \"kubernetes.io/projected/c85eee24-fa6f-4f07-b4dc-31da091b7218-kube-api-access-fsm8s\") pod \"volume-data-source-validator-5d456fdbcd-hn6p7\" (UID: \"c85eee24-fa6f-4f07-b4dc-31da091b7218\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" Jul 07 19:08:38.983790 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.983774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.983897 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.983883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/153b3d70-310e-4e2f-93e4-d9644d890f76-serving-cert\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.983987 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.983973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.984084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-config\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:38.984197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.984197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a44d41-3868-4838-974c-1787e8cb72a5-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.984197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-serving-cert\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:38.984197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.984197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bsm\" (UniqueName: \"kubernetes.io/projected/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-kube-api-access-27bsm\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:38.984446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrp9s\" (UniqueName: \"kubernetes.io/projected/153b3d70-310e-4e2f-93e4-d9644d890f76-kube-api-access-hrp9s\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.984446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-snapshots\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.984446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6lvn\" (UniqueName: \"kubernetes.io/projected/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-kube-api-access-c6lvn\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.984446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qpc\" (UniqueName: \"kubernetes.io/projected/b5a44d41-3868-4838-974c-1787e8cb72a5-kube-api-access-h5qpc\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.984446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-trusted-ca\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984482 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-default-certificate\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-tmp\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984574 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-stats-auth\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a44d41-3868-4838-974c-1787e8cb72a5-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984645 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m96xn\" (UniqueName: \"kubernetes.io/projected/41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb-kube-api-access-m96xn\") pod \"network-check-source-989f8b8dc-mlj2v\" (UID: \"41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvtjt\" (UniqueName: \"kubernetes.io/projected/38bdca46-1403-400c-abd3-c0a566a90be8-kube-api-access-zvtjt\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2kwc\" (UniqueName: \"kubernetes.io/projected/979ebd18-6613-418e-aa59-ced8a44547b3-kube-api-access-f2kwc\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.984717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153b3d70-310e-4e2f-93e4-d9644d890f76-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.985082 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:38.985082 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.984764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:38.985194 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.985177 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-tmp\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.985308 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.985289 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-config\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.985524 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.985501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5a44d41-3868-4838-974c-1787e8cb72a5-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.985831 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.985805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-config\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.988051 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.986620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/153b3d70-310e-4e2f-93e4-d9644d890f76-snapshots\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.988051 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.987637 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5a44d41-3868-4838-974c-1787e8cb72a5-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.988533 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.988515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/153b3d70-310e-4e2f-93e4-d9644d890f76-serving-cert\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.988649 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.988627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:38.992201 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.992176 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsm8s\" (UniqueName: \"kubernetes.io/projected/c85eee24-fa6f-4f07-b4dc-31da091b7218-kube-api-access-fsm8s\") pod \"volume-data-source-validator-5d456fdbcd-hn6p7\" (UID: \"c85eee24-fa6f-4f07-b4dc-31da091b7218\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" Jul 07 19:08:38.993842 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.993779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrp9s\" (UniqueName: \"kubernetes.io/projected/153b3d70-310e-4e2f-93e4-d9644d890f76-kube-api-access-hrp9s\") pod \"insights-operator-5c847dcfc4-xxw5w\" (UID: \"153b3d70-310e-4e2f-93e4-d9644d890f76\") " pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:38.993933 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.993889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m96xn\" (UniqueName: \"kubernetes.io/projected/41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb-kube-api-access-m96xn\") pod \"network-check-source-989f8b8dc-mlj2v\" (UID: \"41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" Jul 07 19:08:38.994485 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.994441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qpc\" (UniqueName: \"kubernetes.io/projected/b5a44d41-3868-4838-974c-1787e8cb72a5-kube-api-access-h5qpc\") pod \"kube-storage-version-migrator-operator-846bf668f7-2dgq7\" (UID: \"b5a44d41-3868-4838-974c-1787e8cb72a5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:38.994621 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:38.994604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6lvn\" (UniqueName: \"kubernetes.io/projected/fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca-kube-api-access-c6lvn\") pod \"service-ca-operator-5d46d9ffd4-p6s88\" (UID: \"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:39.039036 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.039016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" Jul 07 19:08:39.057096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.056975 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" Jul 07 19:08:39.086210 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-serving-cert\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.086342 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bsm\" (UniqueName: \"kubernetes.io/projected/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-kube-api-access-27bsm\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.086342 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086253 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-trusted-ca\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.086342 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-default-certificate\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.086342 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086333 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-stats-auth\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvtjt\" (UniqueName: \"kubernetes.io/projected/38bdca46-1403-400c-abd3-c0a566a90be8-kube-api-access-zvtjt\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086413 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2kwc\" (UniqueName: \"kubernetes.io/projected/979ebd18-6613-418e-aa59-ced8a44547b3-kube-api-access-f2kwc\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086439 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.086597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.086580 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-config\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.086885 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.086788 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:39.086937 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.086888 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:39.586868466 +0000 UTC m=+37.804857080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:39.086937 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.086900 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:39.087044 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.086973 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:39.586954025 +0000 UTC m=+37.804942662 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:39.087140 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.087122 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:39.587106064 +0000 UTC m=+37.805094705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:39.087709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.087677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-trusted-ca\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.087896 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.087831 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-config\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.089321 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.089297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-default-certificate\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.090212 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.090135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-serving-cert\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.090286 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.090231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-stats-auth\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.098751 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.098721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2kwc\" (UniqueName: \"kubernetes.io/projected/979ebd18-6613-418e-aa59-ced8a44547b3-kube-api-access-f2kwc\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.099393 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.099365 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvtjt\" (UniqueName: \"kubernetes.io/projected/38bdca46-1403-400c-abd3-c0a566a90be8-kube-api-access-zvtjt\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:39.100019 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.099994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bsm\" (UniqueName: \"kubernetes.io/projected/e4550fd3-0ad9-4e90-824a-aa5ddd963ffd-kube-api-access-27bsm\") pod \"console-operator-68b757fb67-xwwdx\" (UID: \"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd\") " pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.105718 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.105699 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" Jul 07 19:08:39.119001 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.118957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" Jul 07 19:08:39.127740 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.127703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" Jul 07 19:08:39.179924 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.179899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xxw5w"] Jul 07 19:08:39.191748 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.191714 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153b3d70_310e_4e2f_93e4_d9644d890f76.slice/crio-3308507ca9e532d356f6d43dcde9b69e5a98dd48ffca228bac5ad92c138af017 WatchSource:0}: Error finding container 3308507ca9e532d356f6d43dcde9b69e5a98dd48ffca228bac5ad92c138af017: Status 404 returned error can't find the container with id 3308507ca9e532d356f6d43dcde9b69e5a98dd48ffca228bac5ad92c138af017 Jul 07 19:08:39.217945 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.217812 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:39.351580 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.351507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7"] Jul 07 19:08:39.354252 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.354226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v"] Jul 07 19:08:39.367207 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.367184 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7"] Jul 07 19:08:39.371502 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.371481 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88"] Jul 07 19:08:39.374997 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.374968 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a44d41_3868_4838_974c_1787e8cb72a5.slice/crio-4982c6538ad8b1e75b00075f851b7a2157d6f51d5c70d14e5a7eeef5b20eaf8a WatchSource:0}: Error finding container 4982c6538ad8b1e75b00075f851b7a2157d6f51d5c70d14e5a7eeef5b20eaf8a: Status 404 returned error can't find the container with id 4982c6538ad8b1e75b00075f851b7a2157d6f51d5c70d14e5a7eeef5b20eaf8a Jul 07 19:08:39.376197 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.376166 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ebeaeb_d7d1_43c3_a264_cdc80eaab1bb.slice/crio-f88c08a7f40ebb59f5067ed8fa04840ba32db424245d4116da3337783feb796e WatchSource:0}: Error finding container f88c08a7f40ebb59f5067ed8fa04840ba32db424245d4116da3337783feb796e: Status 404 returned error can't find the container with id f88c08a7f40ebb59f5067ed8fa04840ba32db424245d4116da3337783feb796e Jul 07 19:08:39.377180 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.377152 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85eee24_fa6f_4f07_b4dc_31da091b7218.slice/crio-d94e0ec97c29bb998e9a8d8cf17461ca1c8f41d12d142e73ea061ef9179992c5 WatchSource:0}: Error finding container d94e0ec97c29bb998e9a8d8cf17461ca1c8f41d12d142e73ea061ef9179992c5: Status 404 returned error can't find the container with id d94e0ec97c29bb998e9a8d8cf17461ca1c8f41d12d142e73ea061ef9179992c5 Jul 07 19:08:39.377854 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.377667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8dc4ea_cc00_4fe6_add7_9862e0a9c9ca.slice/crio-8b5dde6a434b2ee1fe1934e33d8247599aa5845cd93aab291bf5bd3ed9d352cc WatchSource:0}: Error finding container 8b5dde6a434b2ee1fe1934e33d8247599aa5845cd93aab291bf5bd3ed9d352cc: Status 404 returned error can't find the container with id 8b5dde6a434b2ee1fe1934e33d8247599aa5845cd93aab291bf5bd3ed9d352cc Jul 07 19:08:39.389873 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.389844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:39.390005 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.389974 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:39.390071 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.390032 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.390012523 +0000 UTC m=+38.608001142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:39.488854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.488827 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-xwwdx"] Jul 07 19:08:39.489224 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.489164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" event={"ID":"c85eee24-fa6f-4f07-b4dc-31da091b7218","Type":"ContainerStarted","Data":"d94e0ec97c29bb998e9a8d8cf17461ca1c8f41d12d142e73ea061ef9179992c5"} Jul 07 19:08:39.490752 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.490728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" event={"ID":"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca","Type":"ContainerStarted","Data":"8b5dde6a434b2ee1fe1934e33d8247599aa5845cd93aab291bf5bd3ed9d352cc"} Jul 07 19:08:39.492038 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.492000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" event={"ID":"41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb","Type":"ContainerStarted","Data":"f88c08a7f40ebb59f5067ed8fa04840ba32db424245d4116da3337783feb796e"} Jul 07 19:08:39.492568 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:08:39.492532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4550fd3_0ad9_4e90_824a_aa5ddd963ffd.slice/crio-31c51df942f557be8d0e05c52740c2149f2846d15b0a2d133b395b6a87a5c803 WatchSource:0}: Error finding container 31c51df942f557be8d0e05c52740c2149f2846d15b0a2d133b395b6a87a5c803: Status 404 returned error can't find the container with id 31c51df942f557be8d0e05c52740c2149f2846d15b0a2d133b395b6a87a5c803 Jul 07 19:08:39.493437 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.493417 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" event={"ID":"153b3d70-310e-4e2f-93e4-d9644d890f76","Type":"ContainerStarted","Data":"3308507ca9e532d356f6d43dcde9b69e5a98dd48ffca228bac5ad92c138af017"} Jul 07 19:08:39.494867 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.494841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qqrjk" event={"ID":"e1da7afd-36dc-4e42-bb9e-fba66fbce76c","Type":"ContainerStarted","Data":"74c17ac7bd7cc5174e9dc74dd6dbbda07ea11e6490233230aeb8bde93df7f756"} Jul 07 19:08:39.499270 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.499245 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="6fe557b1d100dce7c5e2cc55f49ac44aea6bf532ea345c1a4409420558e80f20" exitCode=0 Jul 07 19:08:39.499353 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.499323 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"6fe557b1d100dce7c5e2cc55f49ac44aea6bf532ea345c1a4409420558e80f20"} Jul 07 19:08:39.500995 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.500976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" event={"ID":"b5a44d41-3868-4838-974c-1787e8cb72a5","Type":"ContainerStarted","Data":"4982c6538ad8b1e75b00075f851b7a2157d6f51d5c70d14e5a7eeef5b20eaf8a"} Jul 07 19:08:39.591620 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.591593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:39.592031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.591627 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.592031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:39.591722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:39.592151 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.592122 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.592102188 +0000 UTC m=+38.810090816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:39.592151 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.592129 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:39.592321 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.592170 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.592159069 +0000 UTC m=+38.810147698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:39.592321 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.592227 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:39.592321 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:39.592255 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:40.592246202 +0000 UTC m=+38.810234815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:40.398467 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.398208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:40.398681 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.398644 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:40.398748 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.398712 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:08:42.398689804 +0000 UTC m=+40.616678419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:40.511954 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.511919 2576 generic.go:356] "Generic (PLEG): container finished" podID="9595b8b9-615b-42d6-9d19-cfeb31bff432" containerID="e7008e64ff4d3097f3041204b09acdd17538e761c3c516f75d10c1db1d886243" exitCode=0 Jul 07 19:08:40.512290 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.512056 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerDied","Data":"e7008e64ff4d3097f3041204b09acdd17538e761c3c516f75d10c1db1d886243"} Jul 07 19:08:40.520055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.519915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" event={"ID":"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd","Type":"ContainerStarted","Data":"31c51df942f557be8d0e05c52740c2149f2846d15b0a2d133b395b6a87a5c803"} Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.601205 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.601379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.601408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.602126 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:42.602103884 +0000 UTC m=+40.820092498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.602837 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.602885 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:42.60287025 +0000 UTC m=+40.820858866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.602940 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:40.603001 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.602971 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:42.602961319 +0000 UTC m=+40.820949936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:40.904056 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.903985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:40.904174 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:40.904097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:40.904263 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.904246 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:40.904339 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.904268 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:40.904417 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.904406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:44.904386084 +0000 UTC m=+43.122374704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:40.904875 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.904803 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:40.904875 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:40.904853 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:44.904840133 +0000 UTC m=+43.122828747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:41.529594 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:41.529556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t449w" event={"ID":"9595b8b9-615b-42d6-9d19-cfeb31bff432","Type":"ContainerStarted","Data":"49b628b71fe50b7573e891efcafd6d96329e33dd14045ec27faf1f70e5515401"} Jul 07 19:08:41.555475 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:41.554476 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t449w" podStartSLOduration=16.893762374 podStartE2EDuration="39.554432499s" totalImagesPullingTime="22.660670125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:41.552871364 +0000 UTC m=+39.770860000" watchObservedRunningTime="2026-07-07 19:08:41.554432499 +0000 UTC m=+39.772421153" Jul 07 19:08:42.417138 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:42.417103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:42.417547 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.417256 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:42.417547 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.417331 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:08:46.417307127 +0000 UTC m=+44.635295741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:42.618309 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:42.618272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:42.618309 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:42.618312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:42.618576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:42.618407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:42.618576 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.618472 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:42.618576 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.618545 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:46.618524572 +0000 UTC m=+44.836513203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:42.618736 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.618644 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:46.618623795 +0000 UTC m=+44.836612425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:42.618736 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.618654 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:42.618736 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:42.618695 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:46.618679585 +0000 UTC m=+44.836668207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:44.939144 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:44.939092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:44.939242 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:44.939262 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:44.939383 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:52.939362048 +0000 UTC m=+51.157350666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:44.939405 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:44.939425 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:44.939715 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:44.939499 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:52.939481752 +0000 UTC m=+51.157470390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:46.454379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:46.454321 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:46.454846 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.454471 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:46.454846 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.454543 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:08:54.454519424 +0000 UTC m=+52.672508039 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:46.655749 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:46.655722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:46.655913 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:46.655803 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:46.655913 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:46.655820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:46.655913 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.655893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:54.655874269 +0000 UTC m=+52.873862900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:46.655913 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.655905 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:46.656147 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.655943 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:54.655932916 +0000 UTC m=+52.873921530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:46.656147 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.655952 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:46.656147 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:46.656011 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:08:54.6559958 +0000 UTC m=+52.873984425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:47.549513 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.549469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" event={"ID":"c85eee24-fa6f-4f07-b4dc-31da091b7218","Type":"ContainerStarted","Data":"28470f39a49f4caf25829d888915c7eb42f11d446b092d5dce8b0ce005c34694"} Jul 07 19:08:47.551130 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.551099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" event={"ID":"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca","Type":"ContainerStarted","Data":"9aad3240f5da5704892eb5a7e7aadcd8ccdd4f7592151f41e7a8fd04a384d589"} Jul 07 19:08:47.552917 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.552870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" event={"ID":"41ebeaeb-d7d1-43c3-a264-cdc80eaab1bb","Type":"ContainerStarted","Data":"1eedd7a5634cc4fd2363c7806ad7c7625255a34e2981a6002d93dcb05f8656fe"} Jul 07 19:08:47.554744 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.554722 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" event={"ID":"153b3d70-310e-4e2f-93e4-d9644d890f76","Type":"ContainerStarted","Data":"a2dd4897a0472f2952860a1496a664ebd44a0a4d02a4727aa7590b4c50f362d4"} Jul 07 19:08:47.556602 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.556546 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qqrjk" event={"ID":"e1da7afd-36dc-4e42-bb9e-fba66fbce76c","Type":"ContainerStarted","Data":"806022b289e7d337fc80f9260ad2d2ae42d9021d28e0e7228160d5c6cf7bf299"} Jul 07 19:08:47.558333 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.558312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/0.log" Jul 07 19:08:47.558429 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.558354 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4550fd3-0ad9-4e90-824a-aa5ddd963ffd" containerID="315ebe6ee6a5331b5cd55aa8497ee4d58429276014d510c290e24872f56e9367" exitCode=255 Jul 07 19:08:47.558519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.558429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" event={"ID":"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd","Type":"ContainerDied","Data":"315ebe6ee6a5331b5cd55aa8497ee4d58429276014d510c290e24872f56e9367"} Jul 07 19:08:47.558768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.558671 2576 scope.go:117] "RemoveContainer" containerID="315ebe6ee6a5331b5cd55aa8497ee4d58429276014d510c290e24872f56e9367" Jul 07 19:08:47.560213 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.560193 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" event={"ID":"b5a44d41-3868-4838-974c-1787e8cb72a5","Type":"ContainerStarted","Data":"9035edcba3190b923be55a9a1299916319e9d9f5870376f52eb17894748b1a99"} Jul 07 19:08:47.568195 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.568152 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hn6p7" podStartSLOduration=2.16320077 podStartE2EDuration="9.5681372s" totalImagesPullingTime="7.40493643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.567014089 +0000 UTC m=+45.785002727" watchObservedRunningTime="2026-07-07 19:08:47.5681372 +0000 UTC m=+45.786125816" Jul 07 19:08:47.606158 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.606110 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" podStartSLOduration=2.201193319 podStartE2EDuration="9.606090977s" totalImagesPullingTime="7.404897658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.586771538 +0000 UTC m=+45.804760177" watchObservedRunningTime="2026-07-07 19:08:47.606090977 +0000 UTC m=+45.824079614" Jul 07 19:08:47.627130 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.627084 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" podStartSLOduration=1.893552948 podStartE2EDuration="9.627064233s" totalImagesPullingTime="7.733511285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.625315068 +0000 UTC m=+45.843303705" watchObservedRunningTime="2026-07-07 19:08:47.627064233 +0000 UTC m=+45.845052870" Jul 07 19:08:47.649429 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.649386 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlj2v" podStartSLOduration=2.090204954 podStartE2EDuration="9.649374851s" totalImagesPullingTime="7.559169897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.648758891 +0000 UTC m=+45.866747529" watchObservedRunningTime="2026-07-07 19:08:47.649374851 +0000 UTC m=+45.867363489" Jul 07 19:08:47.670043 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.669904 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" podStartSLOduration=2.120280667 podStartE2EDuration="9.669886325s" totalImagesPullingTime="7.549605658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.667981192 +0000 UTC m=+45.885969830" watchObservedRunningTime="2026-07-07 19:08:47.669886325 +0000 UTC m=+45.887874963" Jul 07 19:08:47.686191 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:47.686142 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qqrjk" podStartSLOduration=2.830233602 podStartE2EDuration="10.686123215s" totalImagesPullingTime="7.855889613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:08:47.685295921 +0000 UTC m=+45.903284558" watchObservedRunningTime="2026-07-07 19:08:47.686123215 +0000 UTC m=+45.904111852" Jul 07 19:08:48.565015 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.564981 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:08:48.565502 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.565486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/0.log" Jul 07 19:08:48.565571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.565529 2576 generic.go:356] "Generic (PLEG): container finished" podID="e4550fd3-0ad9-4e90-824a-aa5ddd963ffd" containerID="2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8" exitCode=255 Jul 07 19:08:48.565637 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.565619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" event={"ID":"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd","Type":"ContainerDied","Data":"2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8"} Jul 07 19:08:48.565690 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.565667 2576 scope.go:117] "RemoveContainer" containerID="315ebe6ee6a5331b5cd55aa8497ee4d58429276014d510c290e24872f56e9367" Jul 07 19:08:48.565890 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.565865 2576 scope.go:117] "RemoveContainer" containerID="2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8" Jul 07 19:08:48.566071 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:48.566051 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xwwdx_openshift-console-operator(e4550fd3-0ad9-4e90-824a-aa5ddd963ffd)\"" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" podUID="e4550fd3-0ad9-4e90-824a-aa5ddd963ffd" Jul 07 19:08:48.697640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.697602 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gnz8s"] Jul 07 19:08:48.725277 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.725229 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnz8s"] Jul 07 19:08:48.725477 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.725389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.728168 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.728142 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 19:08:48.728442 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.728422 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 19:08:48.728791 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.728759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kjmsg\"" Jul 07 19:08:48.781269 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.781240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.781389 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.781288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.781389 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.781310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcwwp\" (UniqueName: \"kubernetes.io/projected/1069f994-77b2-4189-b34d-97408bf6231b-kube-api-access-hcwwp\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.781389 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.781370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1069f994-77b2-4189-b34d-97408bf6231b-crio-socket\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.781532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.781476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1069f994-77b2-4189-b34d-97408bf6231b-data-volume\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.881821 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.881793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1069f994-77b2-4189-b34d-97408bf6231b-data-volume\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.881948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.881868 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.881948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.881904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.881948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.881923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcwwp\" (UniqueName: \"kubernetes.io/projected/1069f994-77b2-4189-b34d-97408bf6231b-kube-api-access-hcwwp\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.882074 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:48.881982 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:08:48.882074 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:48.882030 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:08:48.882074 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:48.882040 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:49.382024206 +0000 UTC m=+47.600012819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : configmap "kube-rbac-proxy" not found Jul 07 19:08:48.882186 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:48.882089 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:49.382069791 +0000 UTC m=+47.600058414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:08:48.882186 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.882131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1069f994-77b2-4189-b34d-97408bf6231b-crio-socket\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.882186 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.882156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1069f994-77b2-4189-b34d-97408bf6231b-data-volume\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.882348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.882293 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1069f994-77b2-4189-b34d-97408bf6231b-crio-socket\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:48.894492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:48.894470 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcwwp\" (UniqueName: \"kubernetes.io/projected/1069f994-77b2-4189-b34d-97408bf6231b-kube-api-access-hcwwp\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:49.218655 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.218583 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:49.218655 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.218625 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:08:49.386035 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.386005 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:49.386179 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.386049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:49.386179 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:49.386144 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:08:49.386248 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:49.386150 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:08:49.386248 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:49.386223 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:50.386202448 +0000 UTC m=+48.604191079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : configmap "kube-rbac-proxy" not found Jul 07 19:08:49.386248 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:49.386244 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:50.386232957 +0000 UTC m=+48.604221571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:08:49.569918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.569844 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:08:49.570285 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:49.570179 2576 scope.go:117] "RemoveContainer" containerID="2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8" Jul 07 19:08:49.570348 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:49.570329 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xwwdx_openshift-console-operator(e4550fd3-0ad9-4e90-824a-aa5ddd963ffd)\"" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" podUID="e4550fd3-0ad9-4e90-824a-aa5ddd963ffd" Jul 07 19:08:50.393095 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:50.393061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:50.393264 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:50.393109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:50.393264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:50.393179 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:08:50.393264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:50.393201 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:08:50.393264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:50.393241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:52.393227536 +0000 UTC m=+50.611216180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : configmap "kube-rbac-proxy" not found Jul 07 19:08:50.393264 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:50.393257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:52.39325109 +0000 UTC m=+50.611239704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:08:50.572633 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:50.572607 2576 scope.go:117] "RemoveContainer" containerID="2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8" Jul 07 19:08:50.572975 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:50.572755 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-xwwdx_openshift-console-operator(e4550fd3-0ad9-4e90-824a-aa5ddd963ffd)\"" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" podUID="e4550fd3-0ad9-4e90-824a-aa5ddd963ffd" Jul 07 19:08:51.064723 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:51.064699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6dj2_97d897b9-5540-4563-aeb8-0612ecd44f9f/dns-node-resolver/0.log" Jul 07 19:08:52.065695 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:52.065670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-scl5n_2dd7d4f5-0d21-426f-ae8e-c6d933f275a5/node-ca/0.log" Jul 07 19:08:52.408448 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:52.408419 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:52.408623 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:52.408482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:52.408623 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:52.408545 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:08:52.408623 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:52.408588 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:08:52.408623 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:52.408605 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:56.408590516 +0000 UTC m=+54.626579132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : configmap "kube-rbac-proxy" not found Jul 07 19:08:52.408756 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:52.408640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:08:56.408627726 +0000 UTC m=+54.626616340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:08:52.864935 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:52.864861 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qqrjk_e1da7afd-36dc-4e42-bb9e-fba66fbce76c/serve-healthcheck-canary/0.log" Jul 07 19:08:53.013693 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:53.013659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:08:53.013846 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:53.013730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:08:53.013846 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:53.013810 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 19:08:53.013846 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:53.013840 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 19:08:53.013939 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:53.013850 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68c5c6567f-tnxtk: secret "image-registry-tls" not found Jul 07 19:08:53.013939 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:53.013872 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls podName:2c71552c-07ac-49be-8d09-5273c6090945 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:09.013856175 +0000 UTC m=+67.231844811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls") pod "dns-default-f7rzd" (UID: "2c71552c-07ac-49be-8d09-5273c6090945") : secret "dns-default-metrics-tls" not found Jul 07 19:08:53.013939 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:53.013890 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls podName:68f8a973-f3f7-4f8a-bf17-3f414a1b7760 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:09.01387895 +0000 UTC m=+67.231867563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls") pod "image-registry-68c5c6567f-tnxtk" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760") : secret "image-registry-tls" not found Jul 07 19:08:53.467148 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:53.467111 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-2dgq7_b5a44d41-3868-4838-974c-1787e8cb72a5/kube-storage-version-migrator-operator/0.log" Jul 07 19:08:54.525371 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:54.525338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:08:54.525813 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.525516 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:54.525813 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.525577 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls podName:8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f nodeName:}" failed. No retries permitted until 2026-07-07 19:09:10.525562669 +0000 UTC m=+68.743551302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-xcqd2" (UID: "8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f") : secret "cluster-monitoring-operator-tls" not found Jul 07 19:08:54.727125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:54.727092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:54.727277 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:54.727212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:08:54.727277 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:54.727235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:08:54.727404 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.727289 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:10.727267457 +0000 UTC m=+68.945256085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : configmap references non-existent config key: service-ca.crt Jul 07 19:08:54.727404 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.727335 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 19:08:54.727404 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.727383 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls podName:38bdca46-1403-400c-abd3-c0a566a90be8 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:10.727372367 +0000 UTC m=+68.945360984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-dvjdt" (UID: "38bdca46-1403-400c-abd3-c0a566a90be8") : secret "samples-operator-tls" not found Jul 07 19:08:54.727404 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.727335 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 19:08:54.727625 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:54.727417 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs podName:979ebd18-6613-418e-aa59-ced8a44547b3 nodeName:}" failed. No retries permitted until 2026-07-07 19:09:10.727405554 +0000 UTC m=+68.945394168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs") pod "router-default-7c6559656f-x5jgr" (UID: "979ebd18-6613-418e-aa59-ced8a44547b3") : secret "router-metrics-certs-default" not found Jul 07 19:08:56.439501 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:56.439466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:56.439851 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:08:56.439516 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:08:56.439851 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:56.439571 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 19:08:56.439851 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:56.439618 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:08:56.439851 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:56.439645 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:09:04.439625648 +0000 UTC m=+62.657614266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : configmap "kube-rbac-proxy" not found Jul 07 19:08:56.439851 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:08:56.439663 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:09:04.439651753 +0000 UTC m=+62.657640385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:09:02.477165 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:02.477132 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbdvk" Jul 07 19:09:04.224956 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.224922 2576 scope.go:117] "RemoveContainer" containerID="2d859c427b50065726c3f604761fd4fde011d88fb43a8e73040e0d3cbe02afa8" Jul 07 19:09:04.505485 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.505357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:04.505485 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.505414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:04.505680 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:04.505546 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 19:09:04.505680 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:04.505604 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls podName:1069f994-77b2-4189-b34d-97408bf6231b nodeName:}" failed. No retries permitted until 2026-07-07 19:09:20.50558552 +0000 UTC m=+78.723574136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gnz8s" (UID: "1069f994-77b2-4189-b34d-97408bf6231b") : secret "insights-runtime-extractor-tls" not found Jul 07 19:09:04.506125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.506107 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1069f994-77b2-4189-b34d-97408bf6231b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:04.614268 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.614239 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:09:04.614478 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.614306 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" event={"ID":"e4550fd3-0ad9-4e90-824a-aa5ddd963ffd","Type":"ContainerStarted","Data":"4138ea7f11641c4c439a6f13f16146a1b7eaa3d932364f2089b2a786ddf9a924"} Jul 07 19:09:04.614695 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.614673 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:09:04.634323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.634275 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" podStartSLOduration=19.201345355 podStartE2EDuration="26.63426101s" totalImagesPullingTime="7.432915655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:04.632967861 +0000 UTC m=+62.850956499" watchObservedRunningTime="2026-07-07 19:09:04.63426101 +0000 UTC m=+62.852249670" Jul 07 19:09:04.702949 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:04.702921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-xwwdx" Jul 07 19:09:08.037438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.037386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:09:08.037924 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.037512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:09:08.037924 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.037595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:09:08.040022 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.039999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pt5v\" (UniqueName: \"kubernetes.io/projected/9d144ea6-3bfa-4da4-a21a-24df1be46adc-kube-api-access-7pt5v\") pod \"network-check-target-bbt5n\" (UID: \"9d144ea6-3bfa-4da4-a21a-24df1be46adc\") " pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:09:08.040537 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.040520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 19:09:08.040605 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.040526 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 19:09:08.049774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.049753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22985704-9f1c-47ed-a6a9-58e6447b2ea0-original-pull-secret\") pod \"global-pull-secret-syncer-bgjzx\" (UID: \"22985704-9f1c-47ed-a6a9-58e6447b2ea0\") " pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:09:08.049915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.049897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca2e302e-fc61-448e-9234-1d7b557acdcc-metrics-certs\") pod \"network-metrics-daemon-8sb6h\" (UID: \"ca2e302e-fc61-448e-9234-1d7b557acdcc\") " pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:09:08.136022 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.135995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7q8zk\"" Jul 07 19:09:08.139210 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.139190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgjzx" Jul 07 19:09:08.143903 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.143884 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:09:08.146678 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.146660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6xjkd\"" Jul 07 19:09:08.153951 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.153932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8sb6h" Jul 07 19:09:08.284440 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.284407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgjzx"] Jul 07 19:09:08.288821 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:08.288769 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22985704_9f1c_47ed_a6a9_58e6447b2ea0.slice/crio-a7de33ea0d4fc4a5f1ed5bc359ebdd38424a63024052104fa3767099c736a51f WatchSource:0}: Error finding container a7de33ea0d4fc4a5f1ed5bc359ebdd38424a63024052104fa3767099c736a51f: Status 404 returned error can't find the container with id a7de33ea0d4fc4a5f1ed5bc359ebdd38424a63024052104fa3767099c736a51f Jul 07 19:09:08.300317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.300294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bbt5n"] Jul 07 19:09:08.303019 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:08.302996 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d144ea6_3bfa_4da4_a21a_24df1be46adc.slice/crio-a5aff1aa07ff8fbee2edc414e904b92c51c05388c7b009cd016448fcd8237abb WatchSource:0}: Error finding container a5aff1aa07ff8fbee2edc414e904b92c51c05388c7b009cd016448fcd8237abb: Status 404 returned error can't find the container with id a5aff1aa07ff8fbee2edc414e904b92c51c05388c7b009cd016448fcd8237abb Jul 07 19:09:08.319066 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.319046 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8sb6h"] Jul 07 19:09:08.328318 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:08.328290 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2e302e_fc61_448e_9234_1d7b557acdcc.slice/crio-06bfea8dce08da2e68e6d1cf6a78c6f2d7f6ab87f35063dcc2ebe690219c8b3d WatchSource:0}: Error finding container 06bfea8dce08da2e68e6d1cf6a78c6f2d7f6ab87f35063dcc2ebe690219c8b3d: Status 404 returned error can't find the container with id 06bfea8dce08da2e68e6d1cf6a78c6f2d7f6ab87f35063dcc2ebe690219c8b3d Jul 07 19:09:08.629535 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.629498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb6h" event={"ID":"ca2e302e-fc61-448e-9234-1d7b557acdcc","Type":"ContainerStarted","Data":"06bfea8dce08da2e68e6d1cf6a78c6f2d7f6ab87f35063dcc2ebe690219c8b3d"} Jul 07 19:09:08.630921 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.630892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbt5n" event={"ID":"9d144ea6-3bfa-4da4-a21a-24df1be46adc","Type":"ContainerStarted","Data":"d0d60428bab6bfe13bdaa64cd3e4456d32c741154489495762a46eba89e139af"} Jul 07 19:09:08.631055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.630935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bbt5n" event={"ID":"9d144ea6-3bfa-4da4-a21a-24df1be46adc","Type":"ContainerStarted","Data":"a5aff1aa07ff8fbee2edc414e904b92c51c05388c7b009cd016448fcd8237abb"} Jul 07 19:09:08.631055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.630991 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:09:08.631880 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.631862 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgjzx" event={"ID":"22985704-9f1c-47ed-a6a9-58e6447b2ea0","Type":"ContainerStarted","Data":"a7de33ea0d4fc4a5f1ed5bc359ebdd38424a63024052104fa3767099c736a51f"} Jul 07 19:09:08.651601 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:08.651545 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bbt5n" podStartSLOduration=66.651530605 podStartE2EDuration="1m6.651530605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:08.650279669 +0000 UTC m=+66.868268305" watchObservedRunningTime="2026-07-07 19:09:08.651530605 +0000 UTC m=+66.869519242" Jul 07 19:09:09.046131 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.046055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:09:09.046574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.046163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:09:09.048853 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.048797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2c71552c-07ac-49be-8d09-5273c6090945-metrics-tls\") pod \"dns-default-f7rzd\" (UID: \"2c71552c-07ac-49be-8d09-5273c6090945\") " pod="openshift-dns/dns-default-f7rzd" Jul 07 19:09:09.049144 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.049100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"image-registry-68c5c6567f-tnxtk\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:09:09.241370 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.241337 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82tfj\"" Jul 07 19:09:09.249537 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.249509 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:09:09.257134 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.257110 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42k7f\"" Jul 07 19:09:09.265272 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.265246 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7rzd" Jul 07 19:09:09.671032 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.671000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:09:09.674878 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:09.674848 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f8a973_f3f7_4f8a_bf17_3f414a1b7760.slice/crio-c0cab3b01bfbb346b1c7478741258cf312abda93735735a5d0f63b16e0cd31ed WatchSource:0}: Error finding container c0cab3b01bfbb346b1c7478741258cf312abda93735735a5d0f63b16e0cd31ed: Status 404 returned error can't find the container with id c0cab3b01bfbb346b1c7478741258cf312abda93735735a5d0f63b16e0cd31ed Jul 07 19:09:09.686550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:09.686401 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7rzd"] Jul 07 19:09:09.689494 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:09.689441 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c71552c_07ac_49be_8d09_5273c6090945.slice/crio-f732482fb2c7e256b709574044768e7849e8776b41333deb12aacd29c3ea2759 WatchSource:0}: Error finding container f732482fb2c7e256b709574044768e7849e8776b41333deb12aacd29c3ea2759: Status 404 returned error can't find the container with id f732482fb2c7e256b709574044768e7849e8776b41333deb12aacd29c3ea2759 Jul 07 19:09:10.558844 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.558801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:09:10.561836 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.561811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-xcqd2\" (UID: \"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:09:10.641699 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.641662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" event={"ID":"68f8a973-f3f7-4f8a-bf17-3f414a1b7760","Type":"ContainerStarted","Data":"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb"} Jul 07 19:09:10.641873 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.641720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" event={"ID":"68f8a973-f3f7-4f8a-bf17-3f414a1b7760","Type":"ContainerStarted","Data":"c0cab3b01bfbb346b1c7478741258cf312abda93735735a5d0f63b16e0cd31ed"} Jul 07 19:09:10.641873 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.641777 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:09:10.644746 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.644714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb6h" event={"ID":"ca2e302e-fc61-448e-9234-1d7b557acdcc","Type":"ContainerStarted","Data":"d83caa4b1ae10e2a9ca7c35fb20a72e3c889cb250bfd8c0a0ef6e4874ab22a3e"} Jul 07 19:09:10.644880 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.644768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8sb6h" event={"ID":"ca2e302e-fc61-448e-9234-1d7b557acdcc","Type":"ContainerStarted","Data":"f86053fff506ccf1ce7a678d86ff78b08a7685e1ad0b917930ac9725f1496ce4"} Jul 07 19:09:10.645948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.645922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7rzd" event={"ID":"2c71552c-07ac-49be-8d09-5273c6090945","Type":"ContainerStarted","Data":"f732482fb2c7e256b709574044768e7849e8776b41333deb12aacd29c3ea2759"} Jul 07 19:09:10.669568 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.669509 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" podStartSLOduration=70.669488325 podStartE2EDuration="1m10.669488325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:10.667873337 +0000 UTC m=+68.885862004" watchObservedRunningTime="2026-07-07 19:09:10.669488325 +0000 UTC m=+68.887476962" Jul 07 19:09:10.690385 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.690330 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8sb6h" podStartSLOduration=67.395503751 podStartE2EDuration="1m8.690312256s" totalImagesPullingTime="1.294808505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:10.688476733 +0000 UTC m=+68.906465370" watchObservedRunningTime="2026-07-07 19:09:10.690312256 +0000 UTC m=+68.908300892" Jul 07 19:09:10.733870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.733833 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nds49\"" Jul 07 19:09:10.741122 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.741094 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" Jul 07 19:09:10.760811 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.760777 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:10.761054 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.761030 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:09:10.761138 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.761075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:10.762008 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.761988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/979ebd18-6613-418e-aa59-ced8a44547b3-service-ca-bundle\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:10.764741 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.764715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979ebd18-6613-418e-aa59-ced8a44547b3-metrics-certs\") pod \"router-default-7c6559656f-x5jgr\" (UID: \"979ebd18-6613-418e-aa59-ced8a44547b3\") " pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:10.764848 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.764772 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38bdca46-1403-400c-abd3-c0a566a90be8-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-dvjdt\" (UID: \"38bdca46-1403-400c-abd3-c0a566a90be8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:09:10.940024 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.939989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-h22ch\"" Jul 07 19:09:10.945415 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.945387 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-24cc5\"" Jul 07 19:09:10.947478 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.947436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" Jul 07 19:09:10.953889 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:10.953867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:12.786505 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:12.784912 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2"] Jul 07 19:09:12.796098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:12.795941 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c6559656f-x5jgr"] Jul 07 19:09:12.802798 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:12.802767 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979ebd18_6613_418e_aa59_ced8a44547b3.slice/crio-f3d4aabe39b38a1edf0bd3a35528d50618fdb90fe1ee723f4336bd99bf221a01 WatchSource:0}: Error finding container f3d4aabe39b38a1edf0bd3a35528d50618fdb90fe1ee723f4336bd99bf221a01: Status 404 returned error can't find the container with id f3d4aabe39b38a1edf0bd3a35528d50618fdb90fe1ee723f4336bd99bf221a01 Jul 07 19:09:12.815594 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:12.815563 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt"] Jul 07 19:09:13.665659 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.665610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgjzx" event={"ID":"22985704-9f1c-47ed-a6a9-58e6447b2ea0","Type":"ContainerStarted","Data":"1784b26db34946d628e5431c41093e2492e77589814fe57bd91f5dfc7400a304"} Jul 07 19:09:13.668061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.668030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7rzd" event={"ID":"2c71552c-07ac-49be-8d09-5273c6090945","Type":"ContainerStarted","Data":"d1396ae4d2d73c5c9f44a9547d76788c8aef0e47f507fc71c359a74e6b3dd308"} Jul 07 19:09:13.668195 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.668085 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7rzd" event={"ID":"2c71552c-07ac-49be-8d09-5273c6090945","Type":"ContainerStarted","Data":"9ea175cd3d26f43269c8122d3a23d18536940dc1ae3d29a8b9311679ae493a32"} Jul 07 19:09:13.668616 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.668596 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f7rzd" Jul 07 19:09:13.670179 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.670152 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" event={"ID":"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f","Type":"ContainerStarted","Data":"8535aacb03a06b4ec28d84be3d85ab1c37a6eaa295e5f1b6f48952b364e458fc"} Jul 07 19:09:13.671937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.671898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" event={"ID":"38bdca46-1403-400c-abd3-c0a566a90be8","Type":"ContainerStarted","Data":"37409ec81f507fa8f19e3b4415205ac4b745f48e5aeaa9fea7034ccd8cd49854"} Jul 07 19:09:13.673946 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.673875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6559656f-x5jgr" event={"ID":"979ebd18-6613-418e-aa59-ced8a44547b3","Type":"ContainerStarted","Data":"43c22548482b45f776e619237329e5f2668f7945e5765944a6bbd88e37ce90a5"} Jul 07 19:09:13.673946 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.673917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c6559656f-x5jgr" event={"ID":"979ebd18-6613-418e-aa59-ced8a44547b3","Type":"ContainerStarted","Data":"f3d4aabe39b38a1edf0bd3a35528d50618fdb90fe1ee723f4336bd99bf221a01"} Jul 07 19:09:13.704739 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.704681 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f7rzd" podStartSLOduration=33.792761068 podStartE2EDuration="36.704661391s" totalImagesPullingTime="2.911900323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:13.703510845 +0000 UTC m=+71.921499481" watchObservedRunningTime="2026-07-07 19:09:13.704661391 +0000 UTC m=+71.922650026" Jul 07 19:09:13.704961 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.704931 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bgjzx" podStartSLOduration=67.391607475 podStartE2EDuration="1m11.70492459s" totalImagesPullingTime="4.313317115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:13.684563931 +0000 UTC m=+71.902552561" watchObservedRunningTime="2026-07-07 19:09:13.70492459 +0000 UTC m=+71.922913227" Jul 07 19:09:13.726717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.726672 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c6559656f-x5jgr" podStartSLOduration=35.726657606 podStartE2EDuration="35.726657606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:13.725317553 +0000 UTC m=+71.943306189" watchObservedRunningTime="2026-07-07 19:09:13.726657606 +0000 UTC m=+71.944646241" Jul 07 19:09:13.954990 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.954906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:13.957610 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:13.957587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:14.678118 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.678032 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:14.679140 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.679118 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c6559656f-x5jgr" Jul 07 19:09:14.987353 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.987267 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-psf9d"] Jul 07 19:09:14.991216 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.991195 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:14.994097 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.994073 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 19:09:14.994097 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.994086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 19:09:14.994244 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.994073 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pwb76\"" Jul 07 19:09:14.997280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.997259 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr"] Jul 07 19:09:14.999809 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:14.999772 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.002574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.002555 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 19:09:15.002669 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.002599 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 19:09:15.002669 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.002639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8hmdj\"" Jul 07 19:09:15.002669 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.002662 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 19:09:15.002887 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.002871 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 19:09:15.007761 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.007740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-psf9d"] Jul 07 19:09:15.017514 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.017424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr"] Jul 07 19:09:15.073396 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.073370 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-8ts4j"] Jul 07 19:09:15.075683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.075656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:15.079341 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.079323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 19:09:15.079447 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.079323 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 19:09:15.079776 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.079759 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4w2hh\"" Jul 07 19:09:15.091365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.091343 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8ts4j"] Jul 07 19:09:15.100520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.100500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d94db7d-c499-40a9-8483-f86db7e76654-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.100618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.100537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.100618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.100565 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.100722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.100650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlgqf\" (UniqueName: \"kubernetes.io/projected/0d94db7d-c499-40a9-8483-f86db7e76654-kube-api-access-jlgqf\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.201149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.201107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.201325 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.201168 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfnnr\" (UniqueName: \"kubernetes.io/projected/574f73e6-a7b4-421f-8d99-968793507a44-kube-api-access-sfnnr\") pod \"downloads-685bfb5f64-8ts4j\" (UID: \"574f73e6-a7b4-421f-8d99-968793507a44\") " pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:15.201325 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.201221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlgqf\" (UniqueName: \"kubernetes.io/projected/0d94db7d-c499-40a9-8483-f86db7e76654-kube-api-access-jlgqf\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.201325 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.201301 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d94db7d-c499-40a9-8483-f86db7e76654-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.201509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.201340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.203133 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.202491 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.204418 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.204394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6f61a552-764d-46cd-bc84-b8d1fc7bbb3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-psf9d\" (UID: \"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.205832 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.205794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d94db7d-c499-40a9-8483-f86db7e76654-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.224156 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.224091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlgqf\" (UniqueName: \"kubernetes.io/projected/0d94db7d-c499-40a9-8483-f86db7e76654-kube-api-access-jlgqf\") pod \"managed-serviceaccount-addon-agent-78678fc74d-55lhr\" (UID: \"0d94db7d-c499-40a9-8483-f86db7e76654\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.302625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.302212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfnnr\" (UniqueName: \"kubernetes.io/projected/574f73e6-a7b4-421f-8d99-968793507a44-kube-api-access-sfnnr\") pod \"downloads-685bfb5f64-8ts4j\" (UID: \"574f73e6-a7b4-421f-8d99-968793507a44\") " pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:15.302625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.302275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" Jul 07 19:09:15.315192 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.315167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfnnr\" (UniqueName: \"kubernetes.io/projected/574f73e6-a7b4-421f-8d99-968793507a44-kube-api-access-sfnnr\") pod \"downloads-685bfb5f64-8ts4j\" (UID: \"574f73e6-a7b4-421f-8d99-968793507a44\") " pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:15.319744 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.319722 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" Jul 07 19:09:15.387900 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.387871 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:15.575633 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.575604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr"] Jul 07 19:09:15.581402 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:15.581369 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d94db7d_c499_40a9_8483_f86db7e76654.slice/crio-087ac7afc6890a19f1d8ea031c4211a3f16b9a7722e5fcf3ae7dc6544d44140e WatchSource:0}: Error finding container 087ac7afc6890a19f1d8ea031c4211a3f16b9a7722e5fcf3ae7dc6544d44140e: Status 404 returned error can't find the container with id 087ac7afc6890a19f1d8ea031c4211a3f16b9a7722e5fcf3ae7dc6544d44140e Jul 07 19:09:15.599218 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.599083 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-psf9d"] Jul 07 19:09:15.602838 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.602572 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-8ts4j"] Jul 07 19:09:15.603716 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:15.603684 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f61a552_764d_46cd_bc84_b8d1fc7bbb3e.slice/crio-0d4189f2fe926eda5f5474b1fed3b45c4ef0ad4e840ea2af70c819a66e1f4cb0 WatchSource:0}: Error finding container 0d4189f2fe926eda5f5474b1fed3b45c4ef0ad4e840ea2af70c819a66e1f4cb0: Status 404 returned error can't find the container with id 0d4189f2fe926eda5f5474b1fed3b45c4ef0ad4e840ea2af70c819a66e1f4cb0 Jul 07 19:09:15.606694 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:15.606671 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574f73e6_a7b4_421f_8d99_968793507a44.slice/crio-e0c99350e351c9e1c03971dba36c83fd19a21222798033e58293017596c2c672 WatchSource:0}: Error finding container e0c99350e351c9e1c03971dba36c83fd19a21222798033e58293017596c2c672: Status 404 returned error can't find the container with id e0c99350e351c9e1c03971dba36c83fd19a21222798033e58293017596c2c672 Jul 07 19:09:15.682621 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.682586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" event={"ID":"38bdca46-1403-400c-abd3-c0a566a90be8","Type":"ContainerStarted","Data":"104457d35227c3521ec92541fad327a7bfaf7e478d8f608dbae69a1795d92850"} Jul 07 19:09:15.682759 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.682643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" event={"ID":"38bdca46-1403-400c-abd3-c0a566a90be8","Type":"ContainerStarted","Data":"63ac3a23accca4b9e6d237df1a777050ca2a39bfdb4244e9bcaaffad4988acc2"} Jul 07 19:09:15.684284 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.684259 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" event={"ID":"8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f","Type":"ContainerStarted","Data":"b6f0a30f3bb15d73c482142fbdc6fe54f9651f94ccb366e902b11d1c332ef1e1"} Jul 07 19:09:15.685418 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.685387 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" event={"ID":"0d94db7d-c499-40a9-8483-f86db7e76654","Type":"ContainerStarted","Data":"087ac7afc6890a19f1d8ea031c4211a3f16b9a7722e5fcf3ae7dc6544d44140e"} Jul 07 19:09:15.686576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.686553 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8ts4j" event={"ID":"574f73e6-a7b4-421f-8d99-968793507a44","Type":"ContainerStarted","Data":"e0c99350e351c9e1c03971dba36c83fd19a21222798033e58293017596c2c672"} Jul 07 19:09:15.687691 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.687661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" event={"ID":"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e","Type":"ContainerStarted","Data":"0d4189f2fe926eda5f5474b1fed3b45c4ef0ad4e840ea2af70c819a66e1f4cb0"} Jul 07 19:09:15.724587 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.724538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-dvjdt" podStartSLOduration=35.20637796 podStartE2EDuration="37.72452012s" totalImagesPullingTime="2.51814216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:15.716749992 +0000 UTC m=+73.934738628" watchObservedRunningTime="2026-07-07 19:09:15.72452012 +0000 UTC m=+73.942508752" Jul 07 19:09:15.757323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:15.757267 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-xcqd2" podStartSLOduration=35.1435516 podStartE2EDuration="37.757248459s" totalImagesPullingTime="2.613696859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:15.755285127 +0000 UTC m=+73.973273767" watchObservedRunningTime="2026-07-07 19:09:15.757248459 +0000 UTC m=+73.975237096" Jul 07 19:09:16.182606 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.182570 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs"] Jul 07 19:09:16.185389 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.185371 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:16.188805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.188784 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hp9pk\"" Jul 07 19:09:16.189399 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.189385 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 19:09:16.201945 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.201924 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs"] Jul 07 19:09:16.265897 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.265866 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:09:16.268031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.268010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.271711 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.271675 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 19:09:16.272000 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.271982 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 19:09:16.272316 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.272200 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 19:09:16.272316 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.272244 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 19:09:16.272316 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.272276 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 19:09:16.273938 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.273917 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j4wl4\"" Jul 07 19:09:16.284854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.284831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:09:16.313366 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.313503 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.313503 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.313601 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.313601 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2pjvs\" (UID: \"2621c54e-3290-4380-b313-83f07586240b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:16.313689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313626 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.313689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.313658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jrvz\" (UniqueName: \"kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414393 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2pjvs\" (UID: \"2621c54e-3290-4380-b313-83f07586240b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:16.414532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414414 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jrvz\" (UniqueName: \"kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414555 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414719 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:16.414573 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 19:09:16.414719 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:16.414640 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates podName:2621c54e-3290-4380-b313-83f07586240b nodeName:}" failed. No retries permitted until 2026-07-07 19:09:16.914620897 +0000 UTC m=+75.132609515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-2pjvs" (UID: "2621c54e-3290-4380-b313-83f07586240b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 19:09:16.414719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.414917 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.414723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.415247 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.415219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.415424 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.415405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.415524 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.415502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.417539 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.417515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.417539 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.417528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.437058 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.436980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jrvz\" (UniqueName: \"kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz\") pod \"console-56f6f98f6f-zrsts\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.579540 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.579215 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:16.761494 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.761409 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:09:16.763945 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:16.763908 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a19023_9f7f_452a_b007_eeda6b22aa49.slice/crio-46ec69df80c9b3e6fedeb98a325e2f53e08299c9b95839837fab19ca85a747e6 WatchSource:0}: Error finding container 46ec69df80c9b3e6fedeb98a325e2f53e08299c9b95839837fab19ca85a747e6: Status 404 returned error can't find the container with id 46ec69df80c9b3e6fedeb98a325e2f53e08299c9b95839837fab19ca85a747e6 Jul 07 19:09:16.921349 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:16.920659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2pjvs\" (UID: \"2621c54e-3290-4380-b313-83f07586240b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:16.921349 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:16.920877 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 19:09:16.921349 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:09:16.920946 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates podName:2621c54e-3290-4380-b313-83f07586240b nodeName:}" failed. No retries permitted until 2026-07-07 19:09:17.920925026 +0000 UTC m=+76.138913649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-2pjvs" (UID: "2621c54e-3290-4380-b313-83f07586240b") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 19:09:17.699202 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:17.699168 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6f98f6f-zrsts" event={"ID":"27a19023-9f7f-452a-b007-eeda6b22aa49","Type":"ContainerStarted","Data":"46ec69df80c9b3e6fedeb98a325e2f53e08299c9b95839837fab19ca85a747e6"} Jul 07 19:09:17.930749 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:17.930704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2pjvs\" (UID: \"2621c54e-3290-4380-b313-83f07586240b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:17.933526 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:17.933495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2621c54e-3290-4380-b313-83f07586240b-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-2pjvs\" (UID: \"2621c54e-3290-4380-b313-83f07586240b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:17.994602 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:17.994521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:19.126844 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.126809 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs"] Jul 07 19:09:19.307191 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:19.307106 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2621c54e_3290_4380_b313_83f07586240b.slice/crio-b025cc5f08cdc99958be375cfadde929369766de243ae2e180054200a167e635 WatchSource:0}: Error finding container b025cc5f08cdc99958be375cfadde929369766de243ae2e180054200a167e635: Status 404 returned error can't find the container with id b025cc5f08cdc99958be375cfadde929369766de243ae2e180054200a167e635 Jul 07 19:09:19.712367 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.712319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" event={"ID":"2621c54e-3290-4380-b313-83f07586240b","Type":"ContainerStarted","Data":"b025cc5f08cdc99958be375cfadde929369766de243ae2e180054200a167e635"} Jul 07 19:09:19.713952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.713920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" event={"ID":"0d94db7d-c499-40a9-8483-f86db7e76654","Type":"ContainerStarted","Data":"fe8690baad6a39d5468146bb9cdfaa5005bcaff6f02c57c9dc7255b65f7fa3d0"} Jul 07 19:09:19.715711 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.715682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" event={"ID":"6f61a552-764d-46cd-bc84-b8d1fc7bbb3e","Type":"ContainerStarted","Data":"b15b2480c205dd79f9943c1bbd8045b8db662a8640f13d73ac3e21d00f8056d1"} Jul 07 19:09:19.732062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.732011 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78678fc74d-55lhr" podStartSLOduration=1.978777804 podStartE2EDuration="5.73199517s" totalImagesPullingTime="3.753217366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:19.731175755 +0000 UTC m=+77.949164391" watchObservedRunningTime="2026-07-07 19:09:19.73199517 +0000 UTC m=+77.949983806" Jul 07 19:09:19.753098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:19.753050 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-psf9d" podStartSLOduration=2.446204532 podStartE2EDuration="5.753034037s" totalImagesPullingTime="3.306829505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:19.752334194 +0000 UTC m=+77.970322830" watchObservedRunningTime="2026-07-07 19:09:19.753034037 +0000 UTC m=+77.971022674" Jul 07 19:09:20.556992 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:20.556941 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:20.559966 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:20.559938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1069f994-77b2-4189-b34d-97408bf6231b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gnz8s\" (UID: \"1069f994-77b2-4189-b34d-97408bf6231b\") " pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:20.838651 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:20.838569 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kjmsg\"" Jul 07 19:09:20.846222 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:20.846187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gnz8s" Jul 07 19:09:22.462934 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.462902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gnz8s"] Jul 07 19:09:22.466515 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:22.466490 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1069f994_77b2_4189_b34d_97408bf6231b.slice/crio-303f6d05503c8cfe15880ece17e4f7445bf28b10a71587c19a39f05c6b39cac1 WatchSource:0}: Error finding container 303f6d05503c8cfe15880ece17e4f7445bf28b10a71587c19a39f05c6b39cac1: Status 404 returned error can't find the container with id 303f6d05503c8cfe15880ece17e4f7445bf28b10a71587c19a39f05c6b39cac1 Jul 07 19:09:22.729732 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.729564 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" event={"ID":"2621c54e-3290-4380-b313-83f07586240b","Type":"ContainerStarted","Data":"2406326e31696bf75a0fc4d7fef6a28ab270f79b6b16e086953064649449288a"} Jul 07 19:09:22.729894 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.729768 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:22.731205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.731177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6f98f6f-zrsts" event={"ID":"27a19023-9f7f-452a-b007-eeda6b22aa49","Type":"ContainerStarted","Data":"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814"} Jul 07 19:09:22.733240 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.733214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnz8s" event={"ID":"1069f994-77b2-4189-b34d-97408bf6231b","Type":"ContainerStarted","Data":"303f6d05503c8cfe15880ece17e4f7445bf28b10a71587c19a39f05c6b39cac1"} Jul 07 19:09:22.734831 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.734815 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" Jul 07 19:09:22.745981 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.745943 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-2pjvs" podStartSLOduration=3.739227107 podStartE2EDuration="6.745929812s" totalImagesPullingTime="3.006702705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:22.745085176 +0000 UTC m=+80.963073815" watchObservedRunningTime="2026-07-07 19:09:22.745929812 +0000 UTC m=+80.963918486" Jul 07 19:09:22.779245 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:22.779206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f6f98f6f-zrsts" podStartSLOduration=1.214649848 podStartE2EDuration="6.77919292s" totalImagesPullingTime="5.564543072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:22.778343675 +0000 UTC m=+80.996332311" watchObservedRunningTime="2026-07-07 19:09:22.77919292 +0000 UTC m=+80.997181556" Jul 07 19:09:24.690851 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:24.690820 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f7rzd" Jul 07 19:09:26.580610 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:26.580580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:26.580883 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:26.580636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:09:26.582021 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:26.581997 2576 patch_prober.go:28] interesting pod/console-56f6f98f6f-zrsts container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jul 07 19:09:26.582117 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:26.582045 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56f6f98f6f-zrsts" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jul 07 19:09:26.754651 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:26.754607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnz8s" event={"ID":"1069f994-77b2-4189-b34d-97408bf6231b","Type":"ContainerStarted","Data":"7b8d4ae5afc436f95cce5116c78c25699f6f619b92dc0c775583eed071b716a9"} Jul 07 19:09:27.762225 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:27.762137 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnz8s" event={"ID":"1069f994-77b2-4189-b34d-97408bf6231b","Type":"ContainerStarted","Data":"e0672280b365805c9cca14be03f9abfe71da62985b98024cc5fe66e7eca6b8b8"} Jul 07 19:09:29.255720 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:29.255420 2576 patch_prober.go:28] interesting pod/image-registry-68c5c6567f-tnxtk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 19:09:29.255720 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:29.255501 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 19:09:30.778950 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:30.778912 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gnz8s" event={"ID":"1069f994-77b2-4189-b34d-97408bf6231b","Type":"ContainerStarted","Data":"acd4b4102949b564d8fca98ea872f26d28e3784ec26ca61f60ae33fe73e9cea4"} Jul 07 19:09:30.806519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:30.804757 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gnz8s" podStartSLOduration=35.397112793 podStartE2EDuration="42.804735173s" totalImagesPullingTime="7.40762238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:08:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:30.802962266 +0000 UTC m=+89.020950902" watchObservedRunningTime="2026-07-07 19:09:30.804735173 +0000 UTC m=+89.022723813" Jul 07 19:09:31.649974 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.649936 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7txjt"] Jul 07 19:09:31.653848 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.653821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.657676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.657407 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 19:09:31.657676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.657498 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 19:09:31.657676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.657527 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 19:09:31.657676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.657536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:09:31.657931 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.657832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7h7cz\"" Jul 07 19:09:31.658676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.658659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 19:09:31.758312 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-sys\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758312 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-root\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758528 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf6nc\" (UniqueName: \"kubernetes.io/projected/3b867cf3-7c52-402c-b995-1a749f8080b0-kube-api-access-lf6nc\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758528 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758467 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-tls\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758631 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-textfile\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758765 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-wtmp\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-metrics-client-ca\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.758954 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.758940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.859890 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.859853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf6nc\" (UniqueName: \"kubernetes.io/projected/3b867cf3-7c52-402c-b995-1a749f8080b0-kube-api-access-lf6nc\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.859901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-tls\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.859946 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-textfile\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.859974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-wtmp\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-metrics-client-ca\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860234 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-sys\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-wtmp\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-root\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-textfile\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-root\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3b867cf3-7c52-402c-b995-1a749f8080b0-sys\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.860918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.860663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-accelerators-collector-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.861078 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.861050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b867cf3-7c52-402c-b995-1a749f8080b0-metrics-client-ca\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.863272 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.863247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-tls\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.863424 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.863404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b867cf3-7c52-402c-b995-1a749f8080b0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.869936 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.869911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf6nc\" (UniqueName: \"kubernetes.io/projected/3b867cf3-7c52-402c-b995-1a749f8080b0-kube-api-access-lf6nc\") pod \"node-exporter-7txjt\" (UID: \"3b867cf3-7c52-402c-b995-1a749f8080b0\") " pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.965230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:31.965130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7txjt" Jul 07 19:09:31.979505 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:31.979447 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b867cf3_7c52_402c_b995_1a749f8080b0.slice/crio-faeb90338a759deb6b48172533e219fcd839a0e8c061aac2d14828884b2999ff WatchSource:0}: Error finding container faeb90338a759deb6b48172533e219fcd839a0e8c061aac2d14828884b2999ff: Status 404 returned error can't find the container with id faeb90338a759deb6b48172533e219fcd839a0e8c061aac2d14828884b2999ff Jul 07 19:09:32.788080 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:32.788039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7txjt" event={"ID":"3b867cf3-7c52-402c-b995-1a749f8080b0","Type":"ContainerStarted","Data":"faeb90338a759deb6b48172533e219fcd839a0e8c061aac2d14828884b2999ff"} Jul 07 19:09:36.455809 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.454996 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:09:36.494925 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.494889 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:09:36.544728 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.544688 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:09:36.544892 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.544832 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.553689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.553661 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 19:09:36.706135 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706135 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706254 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.706445 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.706384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tzkn\" (UniqueName: \"kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.806790 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.806958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.806958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.806958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.806958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.807160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.807160 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.806993 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tzkn\" (UniqueName: \"kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.807716 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.807684 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.807972 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.807939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.808325 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.808282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.808417 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.808373 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.810197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.810155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.810743 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.810715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.816849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.816828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tzkn\" (UniqueName: \"kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn\") pod \"console-79565d78c-8g2xn\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:36.857647 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:36.857616 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:37.256179 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:37.256150 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:09:39.576604 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:39.576580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:09:39.579083 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:09:39.579061 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2992f626_c49f_49e7_9301_a12f31bb28ae.slice/crio-d8c5b7d2d8c4e3a67b8076f21b13aee2f7fa7a90a28aa703318fad79e8a3938b WatchSource:0}: Error finding container d8c5b7d2d8c4e3a67b8076f21b13aee2f7fa7a90a28aa703318fad79e8a3938b: Status 404 returned error can't find the container with id d8c5b7d2d8c4e3a67b8076f21b13aee2f7fa7a90a28aa703318fad79e8a3938b Jul 07 19:09:39.654480 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:39.653680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bbt5n" Jul 07 19:09:39.823390 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:39.823319 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79565d78c-8g2xn" event={"ID":"2992f626-c49f-49e7-9301-a12f31bb28ae","Type":"ContainerStarted","Data":"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448"} Jul 07 19:09:39.823390 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:39.823371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79565d78c-8g2xn" event={"ID":"2992f626-c49f-49e7-9301-a12f31bb28ae","Type":"ContainerStarted","Data":"d8c5b7d2d8c4e3a67b8076f21b13aee2f7fa7a90a28aa703318fad79e8a3938b"} Jul 07 19:09:39.847164 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:39.847119 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79565d78c-8g2xn" podStartSLOduration=3.847103847 podStartE2EDuration="3.847103847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:39.846083656 +0000 UTC m=+98.064072293" watchObservedRunningTime="2026-07-07 19:09:39.847103847 +0000 UTC m=+98.065092483" Jul 07 19:09:40.829720 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.829674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-8ts4j" event={"ID":"574f73e6-a7b4-421f-8d99-968793507a44","Type":"ContainerStarted","Data":"9a5c4ac758a8e46d614e93c584380996949e311b1c9e02068883977c4c165a86"} Jul 07 19:09:40.830688 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.830668 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:40.832805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.832780 2576 generic.go:356] "Generic (PLEG): container finished" podID="3b867cf3-7c52-402c-b995-1a749f8080b0" containerID="cfa733b9890ad1f54a7dfb783dbcfaf202d0d36ddc565e58c99e1cf778d68fd7" exitCode=0 Jul 07 19:09:40.832908 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.832866 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7txjt" event={"ID":"3b867cf3-7c52-402c-b995-1a749f8080b0","Type":"ContainerDied","Data":"cfa733b9890ad1f54a7dfb783dbcfaf202d0d36ddc565e58c99e1cf778d68fd7"} Jul 07 19:09:40.842689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.842668 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-8ts4j" Jul 07 19:09:40.855683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:40.855634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-8ts4j" podStartSLOduration=1.5723011869999999 podStartE2EDuration="25.855617531s" totalImagesPullingTime="24.283316344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:09:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:40.855311015 +0000 UTC m=+99.073299652" watchObservedRunningTime="2026-07-07 19:09:40.855617531 +0000 UTC m=+99.073606167" Jul 07 19:09:41.841084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:41.841049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7txjt" event={"ID":"3b867cf3-7c52-402c-b995-1a749f8080b0","Type":"ContainerStarted","Data":"9b3c0f9a1f027f6896c6b022c1dbb5d369f97429aac5603d2e63ad0b07bcca6a"} Jul 07 19:09:41.841678 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:41.841111 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7txjt" event={"ID":"3b867cf3-7c52-402c-b995-1a749f8080b0","Type":"ContainerStarted","Data":"b649da42af2543999466e47f276c0e6750dfefc27dfd848c2bc18a3aac53420b"} Jul 07 19:09:41.871302 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:41.871250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7txjt" podStartSLOduration=2.232467839 podStartE2EDuration="10.871230975s" totalImagesPullingTime="8.530163203s" totalInitContainerRuntime="108.599933ms" isStatefulPod=true podCreationTimestamp="2026-07-07 19:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:09:41.868610549 +0000 UTC m=+100.086599198" watchObservedRunningTime="2026-07-07 19:09:41.871230975 +0000 UTC m=+100.089219612" Jul 07 19:09:46.858812 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:46.858774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:46.859339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:46.858880 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:46.864722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:46.864705 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:09:47.872401 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:09:47.872368 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:10:01.479084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.479023 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56f6f98f6f-zrsts" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerName="console" containerID="cri-o://87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814" gracePeriod=15 Jul 07 19:10:01.764427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.764405 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:10:01.820802 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820774 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.820937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820822 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jrvz\" (UniqueName: \"kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.820937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820851 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.820937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820904 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.820937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820930 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.821135 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.820952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca\") pod \"27a19023-9f7f-452a-b007-eeda6b22aa49\" (UID: \"27a19023-9f7f-452a-b007-eeda6b22aa49\") " Jul 07 19:10:01.821242 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.821214 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:10:01.821493 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.821334 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config" (OuterVolumeSpecName: "console-config") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:10:01.821588 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.821567 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca" (OuterVolumeSpecName: "service-ca") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:10:01.823265 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.823238 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz" (OuterVolumeSpecName: "kube-api-access-6jrvz") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "kube-api-access-6jrvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:10:01.823685 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.823659 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:10:01.823685 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.823668 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "27a19023-9f7f-452a-b007-eeda6b22aa49" (UID: "27a19023-9f7f-452a-b007-eeda6b22aa49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:10:01.920756 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.920734 2576 generic.go:356] "Generic (PLEG): container finished" podID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerID="87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814" exitCode=0 Jul 07 19:10:01.920849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.920778 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f6f98f6f-zrsts" Jul 07 19:10:01.920889 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.920778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6f98f6f-zrsts" event={"ID":"27a19023-9f7f-452a-b007-eeda6b22aa49","Type":"ContainerDied","Data":"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814"} Jul 07 19:10:01.920922 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.920904 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f6f98f6f-zrsts" event={"ID":"27a19023-9f7f-452a-b007-eeda6b22aa49","Type":"ContainerDied","Data":"46ec69df80c9b3e6fedeb98a325e2f53e08299c9b95839837fab19ca85a747e6"} Jul 07 19:10:01.920954 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.920928 2576 scope.go:117] "RemoveContainer" containerID="87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814" Jul 07 19:10:01.921547 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921530 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.921640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921552 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jrvz\" (UniqueName: \"kubernetes.io/projected/27a19023-9f7f-452a-b007-eeda6b22aa49-kube-api-access-6jrvz\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.921640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921565 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.921640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921578 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.921640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921592 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/27a19023-9f7f-452a-b007-eeda6b22aa49-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.921640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.921603 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/27a19023-9f7f-452a-b007-eeda6b22aa49-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:01.929378 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.929363 2576 scope.go:117] "RemoveContainer" containerID="87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814" Jul 07 19:10:01.929673 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:10:01.929654 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814\": container with ID starting with 87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814 not found: ID does not exist" containerID="87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814" Jul 07 19:10:01.929734 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.929681 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814"} err="failed to get container status \"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814\": rpc error: code = NotFound desc = could not find container \"87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814\": container with ID starting with 87877aee79bcb5da41130da42d6a1ef23ac9fe95409a94048823af2efe508814 not found: ID does not exist" Jul 07 19:10:01.942967 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.942947 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:10:01.949120 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:01.949102 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f6f98f6f-zrsts"] Jul 07 19:10:02.228440 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.228402 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" path="/var/lib/kubelet/pods/27a19023-9f7f-452a-b007-eeda6b22aa49/volumes" Jul 07 19:10:02.279592 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.279540 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerName="registry" containerID="cri-o://20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb" gracePeriod=30 Jul 07 19:10:02.580373 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.580350 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:10:02.727280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727200 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727254 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727287 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727317 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpdrf\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727335 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727371 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727399 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727416 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets\") pod \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\" (UID: \"68f8a973-f3f7-4f8a-bf17-3f414a1b7760\") " Jul 07 19:10:02.727887 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.727839 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:10:02.728132 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.728069 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:10:02.730340 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.730236 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf" (OuterVolumeSpecName: "kube-api-access-wpdrf") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "kube-api-access-wpdrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:10:02.730340 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.730303 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:10:02.730533 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.730394 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:10:02.730577 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.730532 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:10:02.730613 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.730573 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:10:02.736265 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.736243 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "68f8a973-f3f7-4f8a-bf17-3f414a1b7760" (UID: "68f8a973-f3f7-4f8a-bf17-3f414a1b7760"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:10:02.828006 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.827967 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-ca-trust-extracted\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828006 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.827999 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-trusted-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828006 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828012 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-tls\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828022 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpdrf\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-kube-api-access-wpdrf\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828034 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-registry-certificates\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828046 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-image-registry-private-configuration\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828059 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-bound-sa-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.828236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.828069 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/68f8a973-f3f7-4f8a-bf17-3f414a1b7760-installation-pull-secrets\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:10:02.926344 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.926310 2576 generic.go:356] "Generic (PLEG): container finished" podID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerID="20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb" exitCode=0 Jul 07 19:10:02.926519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.926358 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" Jul 07 19:10:02.926519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.926396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" event={"ID":"68f8a973-f3f7-4f8a-bf17-3f414a1b7760","Type":"ContainerDied","Data":"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb"} Jul 07 19:10:02.926519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.926447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68c5c6567f-tnxtk" event={"ID":"68f8a973-f3f7-4f8a-bf17-3f414a1b7760","Type":"ContainerDied","Data":"c0cab3b01bfbb346b1c7478741258cf312abda93735735a5d0f63b16e0cd31ed"} Jul 07 19:10:02.926519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.926494 2576 scope.go:117] "RemoveContainer" containerID="20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb" Jul 07 19:10:02.935182 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.935167 2576 scope.go:117] "RemoveContainer" containerID="20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb" Jul 07 19:10:02.935420 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:10:02.935402 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb\": container with ID starting with 20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb not found: ID does not exist" containerID="20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb" Jul 07 19:10:02.935480 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.935430 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb"} err="failed to get container status \"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb\": rpc error: code = NotFound desc = could not find container \"20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb\": container with ID starting with 20ef300b29968ab0993a494d13cd02e2245ab2a137a48f93d3fe67f30f41d8bb not found: ID does not exist" Jul 07 19:10:02.949493 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.949469 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:10:02.955745 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:02.955726 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68c5c6567f-tnxtk"] Jul 07 19:10:04.228400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:04.228369 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" path="/var/lib/kubelet/pods/68f8a973-f3f7-4f8a-bf17-3f414a1b7760/volumes" Jul 07 19:10:13.967388 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:13.967353 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5a44d41-3868-4838-974c-1787e8cb72a5" containerID="9035edcba3190b923be55a9a1299916319e9d9f5870376f52eb17894748b1a99" exitCode=0 Jul 07 19:10:13.967802 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:13.967428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" event={"ID":"b5a44d41-3868-4838-974c-1787e8cb72a5","Type":"ContainerDied","Data":"9035edcba3190b923be55a9a1299916319e9d9f5870376f52eb17894748b1a99"} Jul 07 19:10:13.967802 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:13.967729 2576 scope.go:117] "RemoveContainer" containerID="9035edcba3190b923be55a9a1299916319e9d9f5870376f52eb17894748b1a99" Jul 07 19:10:14.977866 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:14.977837 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-2dgq7" event={"ID":"b5a44d41-3868-4838-974c-1787e8cb72a5","Type":"ContainerStarted","Data":"2e159140e6154b92abe990b06a877a6761a2eb59ae8c130ab2291fb8ccb49787"} Jul 07 19:10:17.989971 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:17.989941 2576 generic.go:356] "Generic (PLEG): container finished" podID="fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca" containerID="9aad3240f5da5704892eb5a7e7aadcd8ccdd4f7592151f41e7a8fd04a384d589" exitCode=0 Jul 07 19:10:17.990346 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:17.990012 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" event={"ID":"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca","Type":"ContainerDied","Data":"9aad3240f5da5704892eb5a7e7aadcd8ccdd4f7592151f41e7a8fd04a384d589"} Jul 07 19:10:17.990387 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:17.990354 2576 scope.go:117] "RemoveContainer" containerID="9aad3240f5da5704892eb5a7e7aadcd8ccdd4f7592151f41e7a8fd04a384d589" Jul 07 19:10:18.996038 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:18.996005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-p6s88" event={"ID":"fd8dc4ea-cc00-4fe6-add7-9862e0a9c9ca","Type":"ContainerStarted","Data":"98c6c7f6d6ec860b11147568d2bffa1995aa61c7817b5716067f39ce2f7a80b4"} Jul 07 19:10:24.014692 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:24.014657 2576 generic.go:356] "Generic (PLEG): container finished" podID="153b3d70-310e-4e2f-93e4-d9644d890f76" containerID="a2dd4897a0472f2952860a1496a664ebd44a0a4d02a4727aa7590b4c50f362d4" exitCode=0 Jul 07 19:10:24.015093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:24.014730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" event={"ID":"153b3d70-310e-4e2f-93e4-d9644d890f76","Type":"ContainerDied","Data":"a2dd4897a0472f2952860a1496a664ebd44a0a4d02a4727aa7590b4c50f362d4"} Jul 07 19:10:24.015093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:24.015034 2576 scope.go:117] "RemoveContainer" containerID="a2dd4897a0472f2952860a1496a664ebd44a0a4d02a4727aa7590b4c50f362d4" Jul 07 19:10:25.020175 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:10:25.020138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xxw5w" event={"ID":"153b3d70-310e-4e2f-93e4-d9644d890f76","Type":"ContainerStarted","Data":"9c000847e27ebe718abb98c4071641bb36442d31e435c6ae50f51d4c340fc2f2"} Jul 07 19:11:00.407575 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.407471 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.407918 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerName="console" Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.407938 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerName="console" Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.407958 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerName="registry" Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.407966 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerName="registry" Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.408035 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a19023-9f7f-452a-b007-eeda6b22aa49" containerName="console" Jul 07 19:11:00.408178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.408046 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f8a973-f3f7-4f8a-bf17-3f414a1b7760" containerName="registry" Jul 07 19:11:00.410202 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.410178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.442722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.442682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:11:00.456488 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456444 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh44g\" (UniqueName: \"kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456644 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456644 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456644 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456644 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456641 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456790 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456680 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.456790 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.456701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557675 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh44g\" (UniqueName: \"kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557813 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.557881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.557850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.558470 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.558425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.558567 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.558543 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.558640 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.558623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.558789 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.558766 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.560289 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.560270 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.560389 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.560347 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.568104 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.568084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh44g\" (UniqueName: \"kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g\") pod \"console-96c9c88df-l7724\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.719481 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.719375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:00.856053 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:00.855981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:11:00.861038 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:11:00.861007 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04532ccf_fc25_493a_b7be_1c7ed1b0da49.slice/crio-730e7ebb5e8a423715767a3939b2fbb7d3e47de4db51f8e037a28f3af40ec439 WatchSource:0}: Error finding container 730e7ebb5e8a423715767a3939b2fbb7d3e47de4db51f8e037a28f3af40ec439: Status 404 returned error can't find the container with id 730e7ebb5e8a423715767a3939b2fbb7d3e47de4db51f8e037a28f3af40ec439 Jul 07 19:11:01.166201 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:01.166170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c9c88df-l7724" event={"ID":"04532ccf-fc25-493a-b7be-1c7ed1b0da49","Type":"ContainerStarted","Data":"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84"} Jul 07 19:11:01.166368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:01.166219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c9c88df-l7724" event={"ID":"04532ccf-fc25-493a-b7be-1c7ed1b0da49","Type":"ContainerStarted","Data":"730e7ebb5e8a423715767a3939b2fbb7d3e47de4db51f8e037a28f3af40ec439"} Jul 07 19:11:01.192980 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:01.192935 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-96c9c88df-l7724" podStartSLOduration=1.192919193 podStartE2EDuration="1.192919193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:11:01.191946376 +0000 UTC m=+179.409935024" watchObservedRunningTime="2026-07-07 19:11:01.192919193 +0000 UTC m=+179.410907828" Jul 07 19:11:10.719614 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:10.719583 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:10.720154 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:10.719657 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:10.724299 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:10.724281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:11.210429 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:11.210400 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:11:11.270030 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:11.270000 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:11:36.292826 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.292766 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79565d78c-8g2xn" podUID="2992f626-c49f-49e7-9301-a12f31bb28ae" containerName="console" containerID="cri-o://2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448" gracePeriod=15 Jul 07 19:11:36.538056 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.538031 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:11:36.641423 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641394 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641477 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641501 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641546 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641738 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641738 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641628 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tzkn\" (UniqueName: \"kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641738 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert\") pod \"2992f626-c49f-49e7-9301-a12f31bb28ae\" (UID: \"2992f626-c49f-49e7-9301-a12f31bb28ae\") " Jul 07 19:11:36.641876 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641800 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:11:36.641876 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641852 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config" (OuterVolumeSpecName: "console-config") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:11:36.641995 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.641967 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:11:36.642161 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.642142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:11:36.643932 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.643907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn" (OuterVolumeSpecName: "kube-api-access-7tzkn") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "kube-api-access-7tzkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:11:36.644176 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.644157 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:11:36.644239 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.644171 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2992f626-c49f-49e7-9301-a12f31bb28ae" (UID: "2992f626-c49f-49e7-9301-a12f31bb28ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:11:36.742917 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742892 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.742917 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742916 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tzkn\" (UniqueName: \"kubernetes.io/projected/2992f626-c49f-49e7-9301-a12f31bb28ae-kube-api-access-7tzkn\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.743062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742926 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.743062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742936 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.743062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742944 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2992f626-c49f-49e7-9301-a12f31bb28ae-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.743062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742952 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:36.743062 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:36.742966 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2992f626-c49f-49e7-9301-a12f31bb28ae-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:11:37.299148 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.299117 2576 generic.go:356] "Generic (PLEG): container finished" podID="2992f626-c49f-49e7-9301-a12f31bb28ae" containerID="2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448" exitCode=0 Jul 07 19:11:37.299583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.299158 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79565d78c-8g2xn" Jul 07 19:11:37.299583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.299201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79565d78c-8g2xn" event={"ID":"2992f626-c49f-49e7-9301-a12f31bb28ae","Type":"ContainerDied","Data":"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448"} Jul 07 19:11:37.299583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.299248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79565d78c-8g2xn" event={"ID":"2992f626-c49f-49e7-9301-a12f31bb28ae","Type":"ContainerDied","Data":"d8c5b7d2d8c4e3a67b8076f21b13aee2f7fa7a90a28aa703318fad79e8a3938b"} Jul 07 19:11:37.299583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.299268 2576 scope.go:117] "RemoveContainer" containerID="2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448" Jul 07 19:11:37.309610 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.309595 2576 scope.go:117] "RemoveContainer" containerID="2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448" Jul 07 19:11:37.309876 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:11:37.309859 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448\": container with ID starting with 2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448 not found: ID does not exist" containerID="2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448" Jul 07 19:11:37.309919 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.309886 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448"} err="failed to get container status \"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448\": rpc error: code = NotFound desc = could not find container \"2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448\": container with ID starting with 2cbe2446945358692df6a2c0d0ec191b9e3b6a54471435b47ab6a0b6dfb3a448 not found: ID does not exist" Jul 07 19:11:37.323150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.323127 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:11:37.327994 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:37.327974 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79565d78c-8g2xn"] Jul 07 19:11:38.229310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:11:38.229276 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2992f626-c49f-49e7-9301-a12f31bb28ae" path="/var/lib/kubelet/pods/2992f626-c49f-49e7-9301-a12f31bb28ae/volumes" Jul 07 19:12:27.787768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.783237 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c9648bb5-bf4cl"] Jul 07 19:12:27.787768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.783876 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2992f626-c49f-49e7-9301-a12f31bb28ae" containerName="console" Jul 07 19:12:27.787768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.783895 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2992f626-c49f-49e7-9301-a12f31bb28ae" containerName="console" Jul 07 19:12:27.787768 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.784045 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2992f626-c49f-49e7-9301-a12f31bb28ae" containerName="console" Jul 07 19:12:27.788535 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.787971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.796606 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.796580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c9648bb5-bf4cl"] Jul 07 19:12:27.810203 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810203 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-oauth-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810362 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-console-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810362 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-service-ca\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810434 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-oauth-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810487 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-trusted-ca-bundle\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.810528 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.810508 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6jm2\" (UniqueName: \"kubernetes.io/projected/aade6493-c635-46b5-97d2-c32c95abebf1-kube-api-access-k6jm2\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.910857 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910828 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-console-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.910857 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-service-ca\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910887 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-oauth-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-trusted-ca-bundle\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6jm2\" (UniqueName: \"kubernetes.io/projected/aade6493-c635-46b5-97d2-c32c95abebf1-kube-api-access-k6jm2\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.910982 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-oauth-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.911758 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.911730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-service-ca\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.912049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.911730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-oauth-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.912049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.911739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-trusted-ca-bundle\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.912049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.911869 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aade6493-c635-46b5-97d2-c32c95abebf1-console-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.913513 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.913486 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-oauth-config\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.913675 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.913657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aade6493-c635-46b5-97d2-c32c95abebf1-console-serving-cert\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:27.919734 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:27.919717 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6jm2\" (UniqueName: \"kubernetes.io/projected/aade6493-c635-46b5-97d2-c32c95abebf1-kube-api-access-k6jm2\") pod \"console-79c9648bb5-bf4cl\" (UID: \"aade6493-c635-46b5-97d2-c32c95abebf1\") " pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:28.100678 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:28.100595 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:28.239095 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:28.239070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c9648bb5-bf4cl"] Jul 07 19:12:28.241676 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:12:28.241649 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaade6493_c635_46b5_97d2_c32c95abebf1.slice/crio-22a5b9bb7438af9c7d6e294c95adb59679c831327b4e78251dec8381df864d86 WatchSource:0}: Error finding container 22a5b9bb7438af9c7d6e294c95adb59679c831327b4e78251dec8381df864d86: Status 404 returned error can't find the container with id 22a5b9bb7438af9c7d6e294c95adb59679c831327b4e78251dec8381df864d86 Jul 07 19:12:28.494348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:28.494316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c9648bb5-bf4cl" event={"ID":"aade6493-c635-46b5-97d2-c32c95abebf1","Type":"ContainerStarted","Data":"efca1b8f9ce98a443fb4fec9031357f323ab199dab8c748e659630782c167d8d"} Jul 07 19:12:28.494559 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:28.494364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c9648bb5-bf4cl" event={"ID":"aade6493-c635-46b5-97d2-c32c95abebf1","Type":"ContainerStarted","Data":"22a5b9bb7438af9c7d6e294c95adb59679c831327b4e78251dec8381df864d86"} Jul 07 19:12:28.516518 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:28.516471 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79c9648bb5-bf4cl" podStartSLOduration=1.5164360239999999 podStartE2EDuration="1.516436024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:12:28.515863106 +0000 UTC m=+266.733851756" watchObservedRunningTime="2026-07-07 19:12:28.516436024 +0000 UTC m=+266.734424661" Jul 07 19:12:38.100985 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:38.100953 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:38.101449 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:38.101010 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:38.105671 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:38.105649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:38.536796 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:38.536770 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79c9648bb5-bf4cl" Jul 07 19:12:38.616625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:12:38.616588 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:13:02.107079 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:02.107053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:13:02.112606 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:02.112582 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:13:02.118980 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:02.118958 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 19:13:03.640321 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.640278 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-96c9c88df-l7724" podUID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" containerName="console" containerID="cri-o://f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84" gracePeriod=15 Jul 07 19:13:03.882332 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.882309 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:13:03.986683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986609 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh44g\" (UniqueName: \"kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986882 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986732 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986882 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986766 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986882 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986802 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986882 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986830 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.986882 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.986860 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert\") pod \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\" (UID: \"04532ccf-fc25-493a-b7be-1c7ed1b0da49\") " Jul 07 19:13:03.987202 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.987133 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:13:03.987412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.987205 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config" (OuterVolumeSpecName: "console-config") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:13:03.987412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.987270 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca" (OuterVolumeSpecName: "service-ca") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:13:03.987412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.987400 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:13:03.988948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.988927 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:13:03.988948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.988938 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g" (OuterVolumeSpecName: "kube-api-access-nh44g") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "kube-api-access-nh44g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:13:03.989098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:03.988966 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04532ccf-fc25-493a-b7be-1c7ed1b0da49" (UID: "04532ccf-fc25-493a-b7be-1c7ed1b0da49"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:13:04.088209 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088183 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088209 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088209 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088248 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088259 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088271 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh44g\" (UniqueName: \"kubernetes.io/projected/04532ccf-fc25-493a-b7be-1c7ed1b0da49-kube-api-access-nh44g\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088284 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04532ccf-fc25-493a-b7be-1c7ed1b0da49-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.088379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.088296 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04532ccf-fc25-493a-b7be-1c7ed1b0da49-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:04.630360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.630327 2576 generic.go:356] "Generic (PLEG): container finished" podID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" containerID="f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84" exitCode=0 Jul 07 19:13:04.630550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.630371 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-96c9c88df-l7724" Jul 07 19:13:04.630550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.630389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c9c88df-l7724" event={"ID":"04532ccf-fc25-493a-b7be-1c7ed1b0da49","Type":"ContainerDied","Data":"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84"} Jul 07 19:13:04.630550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.630428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-96c9c88df-l7724" event={"ID":"04532ccf-fc25-493a-b7be-1c7ed1b0da49","Type":"ContainerDied","Data":"730e7ebb5e8a423715767a3939b2fbb7d3e47de4db51f8e037a28f3af40ec439"} Jul 07 19:13:04.630550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.630446 2576 scope.go:117] "RemoveContainer" containerID="f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84" Jul 07 19:13:04.638654 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.638633 2576 scope.go:117] "RemoveContainer" containerID="f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84" Jul 07 19:13:04.638949 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:13:04.638926 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84\": container with ID starting with f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84 not found: ID does not exist" containerID="f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84" Jul 07 19:13:04.638994 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.638962 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84"} err="failed to get container status \"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84\": rpc error: code = NotFound desc = could not find container \"f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84\": container with ID starting with f00580b00b8420e5ab0979e8669f4c36415e705cd5379459481c9e04df7d6c84 not found: ID does not exist" Jul 07 19:13:04.648415 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.648390 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:13:04.653274 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:04.653250 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-96c9c88df-l7724"] Jul 07 19:13:06.228977 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:06.228949 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" path="/var/lib/kubelet/pods/04532ccf-fc25-493a-b7be-1c7ed1b0da49/volumes" Jul 07 19:13:18.576739 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.576706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh"] Jul 07 19:13:18.577373 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.576978 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" containerName="console" Jul 07 19:13:18.577373 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.576988 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" containerName="console" Jul 07 19:13:18.577373 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.577033 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="04532ccf-fc25-493a-b7be-1c7ed1b0da49" containerName="console" Jul 07 19:13:18.580079 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.580062 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.582714 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.582695 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pqxq\"" Jul 07 19:13:18.582840 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.582731 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 19:13:18.582840 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.582737 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 19:13:18.590831 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.590808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh"] Jul 07 19:13:18.692620 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.692589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.692776 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.692631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.692776 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.692703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln9fw\" (UniqueName: \"kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.793673 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.793644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln9fw\" (UniqueName: \"kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.793812 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.793693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.793812 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.793721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.794050 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.794034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.794088 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.794063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.804351 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.804326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln9fw\" (UniqueName: \"kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:18.888775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:18.888757 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:19.022399 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:19.022378 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh"] Jul 07 19:13:19.023957 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:13:19.023931 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1ef603_ea28_41c6_a15e_c44cdef093af.slice/crio-09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80 WatchSource:0}: Error finding container 09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80: Status 404 returned error can't find the container with id 09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80 Jul 07 19:13:19.026616 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:19.026600 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:13:19.688469 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:19.688418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerStarted","Data":"09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80"} Jul 07 19:13:29.728865 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:29.728831 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerID="6d4a0196ef2475b5a297cf8ce9994a2175ec388447f0f88ed85dbcb85c1ae2e9" exitCode=0 Jul 07 19:13:29.729277 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:29.728918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerDied","Data":"6d4a0196ef2475b5a297cf8ce9994a2175ec388447f0f88ed85dbcb85c1ae2e9"} Jul 07 19:13:31.739971 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:31.739943 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerID="da5ad1b365ed3e76b7c0910c709dba14d511117df1ca2af559f75013a84be9d7" exitCode=0 Jul 07 19:13:31.740303 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:31.739999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerDied","Data":"da5ad1b365ed3e76b7c0910c709dba14d511117df1ca2af559f75013a84be9d7"} Jul 07 19:13:39.782858 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:39.782819 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerStarted","Data":"d8d22722e914b15bc610466ed30bbc21ed289341d03dbaaa04482b6b8816f83a"} Jul 07 19:13:39.804270 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:39.804229 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" podStartSLOduration=2.065739093 podStartE2EDuration="21.804213732s" totalImagesPullingTime="19.738474639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:39.80398329 +0000 UTC m=+338.021971931" watchObservedRunningTime="2026-07-07 19:13:39.804213732 +0000 UTC m=+338.022202369" Jul 07 19:13:40.788884 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:40.788850 2576 generic.go:356] "Generic (PLEG): container finished" podID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerID="d8d22722e914b15bc610466ed30bbc21ed289341d03dbaaa04482b6b8816f83a" exitCode=0 Jul 07 19:13:40.789263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:40.788908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerDied","Data":"d8d22722e914b15bc610466ed30bbc21ed289341d03dbaaa04482b6b8816f83a"} Jul 07 19:13:41.921862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.921840 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:41.986034 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.986009 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ln9fw\" (UniqueName: \"kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw\") pod \"9a1ef603-ea28-41c6-a15e-c44cdef093af\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " Jul 07 19:13:41.986176 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.986043 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util\") pod \"9a1ef603-ea28-41c6-a15e-c44cdef093af\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " Jul 07 19:13:41.986176 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.986078 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle\") pod \"9a1ef603-ea28-41c6-a15e-c44cdef093af\" (UID: \"9a1ef603-ea28-41c6-a15e-c44cdef093af\") " Jul 07 19:13:41.986787 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.986761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle" (OuterVolumeSpecName: "bundle") pod "9a1ef603-ea28-41c6-a15e-c44cdef093af" (UID: "9a1ef603-ea28-41c6-a15e-c44cdef093af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:13:41.988356 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.988328 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw" (OuterVolumeSpecName: "kube-api-access-ln9fw") pod "9a1ef603-ea28-41c6-a15e-c44cdef093af" (UID: "9a1ef603-ea28-41c6-a15e-c44cdef093af"). InnerVolumeSpecName "kube-api-access-ln9fw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:13:41.990519 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:41.990496 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util" (OuterVolumeSpecName: "util") pod "9a1ef603-ea28-41c6-a15e-c44cdef093af" (UID: "9a1ef603-ea28-41c6-a15e-c44cdef093af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:13:42.087671 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.087588 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:42.087671 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.087617 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ln9fw\" (UniqueName: \"kubernetes.io/projected/9a1ef603-ea28-41c6-a15e-c44cdef093af-kube-api-access-ln9fw\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:42.087671 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.087630 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a1ef603-ea28-41c6-a15e-c44cdef093af-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:42.798162 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.798134 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" Jul 07 19:13:42.798162 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.798158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n9lmh" event={"ID":"9a1ef603-ea28-41c6-a15e-c44cdef093af","Type":"ContainerDied","Data":"09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80"} Jul 07 19:13:42.798401 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:42.798200 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09e8f5e0822ab91b764ebf83193d87886775e9943e140536db411984d4ae7e80" Jul 07 19:13:46.610799 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.610775 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc"] Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611049 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="pull" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611059 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="pull" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611068 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="util" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611074 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="util" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611083 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="extract" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611089 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="extract" Jul 07 19:13:46.611181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.611132 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1ef603-ea28-41c6-a15e-c44cdef093af" containerName="extract" Jul 07 19:13:46.655990 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.655958 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc"] Jul 07 19:13:46.656134 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.656050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.658916 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.658890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:13:46.659042 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.658932 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 19:13:46.659042 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.658939 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-m7pbn\"" Jul 07 19:13:46.725497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.725468 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad04028-237f-44b1-b4dd-9289dadf29dd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.725620 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.725535 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwwjn\" (UniqueName: \"kubernetes.io/projected/5ad04028-237f-44b1-b4dd-9289dadf29dd-kube-api-access-dwwjn\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.826478 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.826420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwwjn\" (UniqueName: \"kubernetes.io/projected/5ad04028-237f-44b1-b4dd-9289dadf29dd-kube-api-access-dwwjn\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.826612 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.826486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad04028-237f-44b1-b4dd-9289dadf29dd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.826842 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.826826 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ad04028-237f-44b1-b4dd-9289dadf29dd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.839783 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.839763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwwjn\" (UniqueName: \"kubernetes.io/projected/5ad04028-237f-44b1-b4dd-9289dadf29dd-kube-api-access-dwwjn\") pod \"cert-manager-operator-controller-manager-55c444bf86-m7tkc\" (UID: \"5ad04028-237f-44b1-b4dd-9289dadf29dd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:46.964637 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:46.964611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" Jul 07 19:13:47.162896 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:47.162863 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc"] Jul 07 19:13:47.166739 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:13:47.166714 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad04028_237f_44b1_b4dd_9289dadf29dd.slice/crio-c48158fae873ae39b6a40fc11519d4485ef389f589eb24873be043d1477a26d7 WatchSource:0}: Error finding container c48158fae873ae39b6a40fc11519d4485ef389f589eb24873be043d1477a26d7: Status 404 returned error can't find the container with id c48158fae873ae39b6a40fc11519d4485ef389f589eb24873be043d1477a26d7 Jul 07 19:13:47.820549 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:47.820513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" event={"ID":"5ad04028-237f-44b1-b4dd-9289dadf29dd","Type":"ContainerStarted","Data":"c48158fae873ae39b6a40fc11519d4485ef389f589eb24873be043d1477a26d7"} Jul 07 19:13:49.830805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:49.830770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" event={"ID":"5ad04028-237f-44b1-b4dd-9289dadf29dd","Type":"ContainerStarted","Data":"c8ca951825a49df2d9364fbdab12db1dd7a4a53f1ed83de535401811af6e2ae9"} Jul 07 19:13:49.860671 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:49.860629 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m7tkc" podStartSLOduration=2.012500233 podStartE2EDuration="3.860612618s" totalImagesPullingTime="1.848112385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:49.859602669 +0000 UTC m=+348.077591306" watchObservedRunningTime="2026-07-07 19:13:49.860612618 +0000 UTC m=+348.078601254" Jul 07 19:13:50.895847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.895813 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455"] Jul 07 19:13:50.918205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.918174 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455"] Jul 07 19:13:50.918366 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.918324 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:50.921817 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.921794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pqxq\"" Jul 07 19:13:50.922349 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.922335 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 19:13:50.922844 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.922823 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 19:13:50.959351 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.959332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:50.959448 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.959359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn5lc\" (UniqueName: \"kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:50.959448 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:50.959391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.060744 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.060716 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.061410 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.060751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn5lc\" (UniqueName: \"kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.061410 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.061275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.061595 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.061541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.066014 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.061641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.071883 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.071863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn5lc\" (UniqueName: \"kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.227650 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.227591 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:51.392259 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.392234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455"] Jul 07 19:13:51.393990 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:13:51.393962 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5574127a_c150_4c90_a40d_96add0a8ff1f.slice/crio-7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b WatchSource:0}: Error finding container 7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b: Status 404 returned error can't find the container with id 7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b Jul 07 19:13:51.841642 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.841560 2576 generic.go:356] "Generic (PLEG): container finished" podID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerID="a9c66055947b096c23e706035c70e0ee8e65923270ff90262df387042027f65b" exitCode=0 Jul 07 19:13:51.841642 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.841606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerDied","Data":"a9c66055947b096c23e706035c70e0ee8e65923270ff90262df387042027f65b"} Jul 07 19:13:51.841642 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:51.841641 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerStarted","Data":"7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b"} Jul 07 19:13:53.852836 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:53.852798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerStarted","Data":"c25eda5f88f4973e3103f806bf8b49964c37480ed6cebd4f9c8b2ad14b1c7e74"} Jul 07 19:13:54.858309 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:54.858274 2576 generic.go:356] "Generic (PLEG): container finished" podID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerID="c25eda5f88f4973e3103f806bf8b49964c37480ed6cebd4f9c8b2ad14b1c7e74" exitCode=0 Jul 07 19:13:54.858807 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:54.858358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerDied","Data":"c25eda5f88f4973e3103f806bf8b49964c37480ed6cebd4f9c8b2ad14b1c7e74"} Jul 07 19:13:55.864327 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:55.864282 2576 generic.go:356] "Generic (PLEG): container finished" podID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerID="412cb6253e5fb663745355716874b036485f9966cd25d974d1a2e92da9e59fe5" exitCode=0 Jul 07 19:13:55.864712 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:55.864331 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerDied","Data":"412cb6253e5fb663745355716874b036485f9966cd25d974d1a2e92da9e59fe5"} Jul 07 19:13:56.994443 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:56.994419 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:13:57.112021 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.111983 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn5lc\" (UniqueName: \"kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc\") pod \"5574127a-c150-4c90-a40d-96add0a8ff1f\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " Jul 07 19:13:57.112192 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.112042 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle\") pod \"5574127a-c150-4c90-a40d-96add0a8ff1f\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " Jul 07 19:13:57.112192 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.112108 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util\") pod \"5574127a-c150-4c90-a40d-96add0a8ff1f\" (UID: \"5574127a-c150-4c90-a40d-96add0a8ff1f\") " Jul 07 19:13:57.112435 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.112411 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle" (OuterVolumeSpecName: "bundle") pod "5574127a-c150-4c90-a40d-96add0a8ff1f" (UID: "5574127a-c150-4c90-a40d-96add0a8ff1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:13:57.114237 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.114206 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc" (OuterVolumeSpecName: "kube-api-access-bn5lc") pod "5574127a-c150-4c90-a40d-96add0a8ff1f" (UID: "5574127a-c150-4c90-a40d-96add0a8ff1f"). InnerVolumeSpecName "kube-api-access-bn5lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:13:57.116697 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.116679 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util" (OuterVolumeSpecName: "util") pod "5574127a-c150-4c90-a40d-96add0a8ff1f" (UID: "5574127a-c150-4c90-a40d-96add0a8ff1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:13:57.212782 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.212745 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:57.212782 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.212775 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn5lc\" (UniqueName: \"kubernetes.io/projected/5574127a-c150-4c90-a40d-96add0a8ff1f-kube-api-access-bn5lc\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:57.212782 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.212788 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5574127a-c150-4c90-a40d-96add0a8ff1f-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:13:57.874888 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.874855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" event={"ID":"5574127a-c150-4c90-a40d-96add0a8ff1f","Type":"ContainerDied","Data":"7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b"} Jul 07 19:13:57.875052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.874905 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e8562ef1cfb71d922a93ff65836c6afd0636324b30295b73ee0d5ffda27586b" Jul 07 19:13:57.875052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:13:57.874861 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5c455" Jul 07 19:14:00.859918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.859890 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hf4w"] Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860147 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="util" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860157 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="util" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860168 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="pull" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860174 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="pull" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860181 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="extract" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860186 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="extract" Jul 07 19:14:00.860438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.860239 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5574127a-c150-4c90-a40d-96add0a8ff1f" containerName="extract" Jul 07 19:14:00.863315 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.863298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:00.867471 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.866318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 19:14:00.867471 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.866319 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rpxhx\"" Jul 07 19:14:00.867471 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.867320 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 19:14:00.876418 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.876396 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hf4w"] Jul 07 19:14:00.942991 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.942952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zvln\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-kube-api-access-7zvln\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:00.942991 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:00.942992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.043691 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.043654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zvln\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-kube-api-access-7zvln\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.043691 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.043691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.054283 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.054191 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-bound-sa-token\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.056017 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.055997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zvln\" (UniqueName: \"kubernetes.io/projected/ceca69f4-2484-444c-8410-8379354498c2-kube-api-access-7zvln\") pod \"cert-manager-55b4d954d5-8hf4w\" (UID: \"ceca69f4-2484-444c-8410-8379354498c2\") " pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.175937 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.175894 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8hf4w" Jul 07 19:14:01.317498 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.317471 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8hf4w"] Jul 07 19:14:01.319002 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:01.318971 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podceca69f4_2484_444c_8410_8379354498c2.slice/crio-12ef77035c7ccd80d17a7674a89311d592decdebd5b3cda6540e8768921a70e2 WatchSource:0}: Error finding container 12ef77035c7ccd80d17a7674a89311d592decdebd5b3cda6540e8768921a70e2: Status 404 returned error can't find the container with id 12ef77035c7ccd80d17a7674a89311d592decdebd5b3cda6540e8768921a70e2 Jul 07 19:14:01.894716 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:01.894676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8hf4w" event={"ID":"ceca69f4-2484-444c-8410-8379354498c2","Type":"ContainerStarted","Data":"12ef77035c7ccd80d17a7674a89311d592decdebd5b3cda6540e8768921a70e2"} Jul 07 19:14:03.489538 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.489500 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs"] Jul 07 19:14:03.493084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.493065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.496579 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.496557 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 19:14:03.497407 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.497384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sdf2p\"" Jul 07 19:14:03.497577 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.497393 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 19:14:03.503197 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.503177 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs"] Jul 07 19:14:03.564184 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.564148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfs6\" (UniqueName: \"kubernetes.io/projected/8e191807-ae79-4728-8c76-12c5f5886360-kube-api-access-wpfs6\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.564347 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.564211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e191807-ae79-4728-8c76-12c5f5886360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.665652 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.665617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfs6\" (UniqueName: \"kubernetes.io/projected/8e191807-ae79-4728-8c76-12c5f5886360-kube-api-access-wpfs6\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.665834 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.665670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e191807-ae79-4728-8c76-12c5f5886360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.666031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.666011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8e191807-ae79-4728-8c76-12c5f5886360-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.676032 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.676010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfs6\" (UniqueName: \"kubernetes.io/projected/8e191807-ae79-4728-8c76-12c5f5886360-kube-api-access-wpfs6\") pod \"openshift-lws-operator-fd8ccff4c-cjmzs\" (UID: \"8e191807-ae79-4728-8c76-12c5f5886360\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.804955 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.804876 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" Jul 07 19:14:03.907797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.907768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8hf4w" event={"ID":"ceca69f4-2484-444c-8410-8379354498c2","Type":"ContainerStarted","Data":"5db9372a00fd55070cc03393cee7d3466f2274bdb3d7c0bc2d10620c5e73773d"} Jul 07 19:14:03.926019 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.925974 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8hf4w" podStartSLOduration=1.575954171 podStartE2EDuration="3.925950093s" totalImagesPullingTime="2.349995922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:03.925864394 +0000 UTC m=+362.143853030" watchObservedRunningTime="2026-07-07 19:14:03.925950093 +0000 UTC m=+362.143938730" Jul 07 19:14:03.938958 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:03.938921 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs"] Jul 07 19:14:03.940680 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:03.940650 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e191807_ae79_4728_8c76_12c5f5886360.slice/crio-13166f20082f5601e17a0e9ce8280d8dcfeba8bfc41c95e835fad440b45643f7 WatchSource:0}: Error finding container 13166f20082f5601e17a0e9ce8280d8dcfeba8bfc41c95e835fad440b45643f7: Status 404 returned error can't find the container with id 13166f20082f5601e17a0e9ce8280d8dcfeba8bfc41c95e835fad440b45643f7 Jul 07 19:14:04.914120 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:04.914077 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" event={"ID":"8e191807-ae79-4728-8c76-12c5f5886360","Type":"ContainerStarted","Data":"13166f20082f5601e17a0e9ce8280d8dcfeba8bfc41c95e835fad440b45643f7"} Jul 07 19:14:05.920297 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:05.920266 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" event={"ID":"8e191807-ae79-4728-8c76-12c5f5886360","Type":"ContainerStarted","Data":"228321b8b2e19142aa11aad623095b711e8f52e1641b99d95a3ed41359936325"} Jul 07 19:14:05.939746 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:05.939697 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cjmzs" podStartSLOduration=1.456955329 podStartE2EDuration="2.939681536s" totalImagesPullingTime="1.482726207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:05.93789089 +0000 UTC m=+364.155879526" watchObservedRunningTime="2026-07-07 19:14:05.939681536 +0000 UTC m=+364.157670173" Jul 07 19:14:08.757662 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.757628 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm"] Jul 07 19:14:08.761100 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.761079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.766725 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.766698 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 19:14:08.766849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.766700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2pqxq\"" Jul 07 19:14:08.766849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.766736 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 19:14:08.778812 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.778787 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm"] Jul 07 19:14:08.805203 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.805172 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.805329 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.805215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.805329 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.805246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dv4\" (UniqueName: \"kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.906130 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.906099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.906256 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.906143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.906256 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.906164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dv4\" (UniqueName: \"kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.906522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.906503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.906563 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.906527 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:08.917150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:08.917130 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dv4\" (UniqueName: \"kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:09.070289 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:09.070216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:09.208943 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:09.208919 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm"] Jul 07 19:14:09.211086 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:09.211049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6695fe9f_6e0d_4c1c_ac19_6e3bd64d7f5a.slice/crio-fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b WatchSource:0}: Error finding container fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b: Status 404 returned error can't find the container with id fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b Jul 07 19:14:09.939170 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:09.939134 2576 generic.go:356] "Generic (PLEG): container finished" podID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerID="1c7dcf9f8899f4a26d89155660bd30aeba5bed0afc8fc92d91e5089d9aef155f" exitCode=0 Jul 07 19:14:09.939553 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:09.939201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" event={"ID":"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a","Type":"ContainerDied","Data":"1c7dcf9f8899f4a26d89155660bd30aeba5bed0afc8fc92d91e5089d9aef155f"} Jul 07 19:14:09.939553 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:09.939246 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" event={"ID":"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a","Type":"ContainerStarted","Data":"fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b"} Jul 07 19:14:10.944843 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:10.944810 2576 generic.go:356] "Generic (PLEG): container finished" podID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerID="02eaab3949e4699514a2814301e3bff6a7cba02c137bef86afb31bb32da8778f" exitCode=0 Jul 07 19:14:10.945254 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:10.944844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" event={"ID":"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a","Type":"ContainerDied","Data":"02eaab3949e4699514a2814301e3bff6a7cba02c137bef86afb31bb32da8778f"} Jul 07 19:14:11.951269 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:11.951234 2576 generic.go:356] "Generic (PLEG): container finished" podID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerID="2b8bffb4dd76f92e0ad238269713b0e5fa3c5d15b07a7cd48676e2f39b3d1424" exitCode=0 Jul 07 19:14:11.951269 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:11.951271 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" event={"ID":"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a","Type":"ContainerDied","Data":"2b8bffb4dd76f92e0ad238269713b0e5fa3c5d15b07a7cd48676e2f39b3d1424"} Jul 07 19:14:13.081148 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.081125 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:13.140249 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.140218 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util\") pod \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " Jul 07 19:14:13.140395 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.140285 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6dv4\" (UniqueName: \"kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4\") pod \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " Jul 07 19:14:13.140395 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.140328 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle\") pod \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\" (UID: \"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a\") " Jul 07 19:14:13.141046 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.140954 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle" (OuterVolumeSpecName: "bundle") pod "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" (UID: "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:14:13.142441 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.142414 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4" (OuterVolumeSpecName: "kube-api-access-d6dv4") pod "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" (UID: "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a"). InnerVolumeSpecName "kube-api-access-d6dv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:14:13.145616 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.145597 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util" (OuterVolumeSpecName: "util") pod "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" (UID: "6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:14:13.241025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.240965 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:14:13.241025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.240989 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6dv4\" (UniqueName: \"kubernetes.io/projected/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-kube-api-access-d6dv4\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:14:13.241025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.240999 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:14:13.961583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.961551 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" Jul 07 19:14:13.961764 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.961556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6f8rm" event={"ID":"6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a","Type":"ContainerDied","Data":"fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b"} Jul 07 19:14:13.961764 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:13.961664 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd58b7991c60e2bfc28de0cdf283e40df83b075b055e364285f9b7abac77854b" Jul 07 19:14:22.480026 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.479993 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q"] Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480273 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="extract" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480284 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="extract" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480304 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="util" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480309 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="util" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480316 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="pull" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480321 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="pull" Jul 07 19:14:22.480411 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.480372 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6695fe9f-6e0d-4c1c-ac19-6e3bd64d7f5a" containerName="extract" Jul 07 19:14:22.485850 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.485829 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.488406 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.488380 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 19:14:22.488539 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.488495 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dfzj8\"" Jul 07 19:14:22.488814 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.488787 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 19:14:22.488874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.488825 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 19:14:22.488918 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.488884 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 19:14:22.498734 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.498711 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q"] Jul 07 19:14:22.616142 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.616113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-webhook-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.616310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.616156 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj9tg\" (UniqueName: \"kubernetes.io/projected/6b1f0a3f-060f-4de0-b9d8-720b1850e103-kube-api-access-kj9tg\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.616310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.616197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.616310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.616219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-tmp\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.616310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.616241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-manifests\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717037 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-tmp\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717175 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-manifests\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717175 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-webhook-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717175 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj9tg\" (UniqueName: \"kubernetes.io/projected/6b1f0a3f-060f-4de0-b9d8-720b1850e103-kube-api-access-kj9tg\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717175 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.717506 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.717474 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-manifests\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.719514 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.719488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1f0a3f-060f-4de0-b9d8-720b1850e103-tmp\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.719607 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.719570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-webhook-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.719698 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.719681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1f0a3f-060f-4de0-b9d8-720b1850e103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.729021 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.728999 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj9tg\" (UniqueName: \"kubernetes.io/projected/6b1f0a3f-060f-4de0-b9d8-720b1850e103-kube-api-access-kj9tg\") pod \"opendatahub-operator-controller-manager-8689849645-t2j5q\" (UID: \"6b1f0a3f-060f-4de0-b9d8-720b1850e103\") " pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.796567 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.796508 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:22.949336 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:22.949309 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q"] Jul 07 19:14:22.952401 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:22.952373 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1f0a3f_060f_4de0_b9d8_720b1850e103.slice/crio-d55d14744c3eccafea287f863fc33caa628194c122799cf2d9027f5e44b43308 WatchSource:0}: Error finding container d55d14744c3eccafea287f863fc33caa628194c122799cf2d9027f5e44b43308: Status 404 returned error can't find the container with id d55d14744c3eccafea287f863fc33caa628194c122799cf2d9027f5e44b43308 Jul 07 19:14:23.005291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:23.005255 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" event={"ID":"6b1f0a3f-060f-4de0-b9d8-720b1850e103","Type":"ContainerStarted","Data":"d55d14744c3eccafea287f863fc33caa628194c122799cf2d9027f5e44b43308"} Jul 07 19:14:27.029045 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:27.029007 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" event={"ID":"6b1f0a3f-060f-4de0-b9d8-720b1850e103","Type":"ContainerStarted","Data":"b4f2a78fe7da5defb7a4466a3efaf826bf4654cfcbf94c41aae1a90494ae8df1"} Jul 07 19:14:28.035326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:28.035297 2576 generic.go:356] "Generic (PLEG): container finished" podID="6b1f0a3f-060f-4de0-b9d8-720b1850e103" containerID="b4f2a78fe7da5defb7a4466a3efaf826bf4654cfcbf94c41aae1a90494ae8df1" exitCode=0 Jul 07 19:14:28.035755 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:28.035389 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" event={"ID":"6b1f0a3f-060f-4de0-b9d8-720b1850e103","Type":"ContainerDied","Data":"b4f2a78fe7da5defb7a4466a3efaf826bf4654cfcbf94c41aae1a90494ae8df1"} Jul 07 19:14:29.041753 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:29.041711 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" event={"ID":"6b1f0a3f-060f-4de0-b9d8-720b1850e103","Type":"ContainerStarted","Data":"5923226409e79a716f1e1351061408b40abf4cfefb2c7774d555ac830e949b5c"} Jul 07 19:14:29.042188 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:29.041851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:29.072288 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:29.072244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" podStartSLOduration=2.176003755 podStartE2EDuration="7.072230972s" totalImagesPullingTime="3.82858918s" totalInitContainerRuntime="1.067638037s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:29.070483779 +0000 UTC m=+387.288472415" watchObservedRunningTime="2026-07-07 19:14:29.072230972 +0000 UTC m=+387.290219608" Jul 07 19:14:40.049276 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:40.049239 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8689849645-t2j5q" Jul 07 19:14:43.242068 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.242034 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx"] Jul 07 19:14:43.247412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.247393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.251956 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.251936 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 19:14:43.262861 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.262837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 19:14:43.272052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.272037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-88g76\"" Jul 07 19:14:43.288909 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.288884 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx"] Jul 07 19:14:43.381868 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.381836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tls-certs\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.381868 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.381874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tmp\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.382151 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.381915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ffht\" (UniqueName: \"kubernetes.io/projected/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-kube-api-access-2ffht\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.483205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.483161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tls-certs\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.483205 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.483203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tmp\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.483484 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.483231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ffht\" (UniqueName: \"kubernetes.io/projected/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-kube-api-access-2ffht\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.485707 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.485677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tmp\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.485888 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.485854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-tls-certs\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.511138 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.511073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ffht\" (UniqueName: \"kubernetes.io/projected/e870ab2f-9cd5-419c-aedd-8ab1cec04fcc-kube-api-access-2ffht\") pod \"kube-auth-proxy-777c59bd5f-kdwqx\" (UID: \"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc\") " pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.557152 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.557126 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" Jul 07 19:14:43.719826 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:43.719670 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx"] Jul 07 19:14:43.720093 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:43.720040 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode870ab2f_9cd5_419c_aedd_8ab1cec04fcc.slice/crio-dd187f96ff9e0d2e22c0e893449bc17d26fae8a233edd75cc141344ad5c990ed WatchSource:0}: Error finding container dd187f96ff9e0d2e22c0e893449bc17d26fae8a233edd75cc141344ad5c990ed: Status 404 returned error can't find the container with id dd187f96ff9e0d2e22c0e893449bc17d26fae8a233edd75cc141344ad5c990ed Jul 07 19:14:44.109305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:44.109274 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" event={"ID":"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc","Type":"ContainerStarted","Data":"dd187f96ff9e0d2e22c0e893449bc17d26fae8a233edd75cc141344ad5c990ed"} Jul 07 19:14:48.131352 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:48.131316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" event={"ID":"e870ab2f-9cd5-419c-aedd-8ab1cec04fcc","Type":"ContainerStarted","Data":"452970c668a7aa05eb561f70a610b3a21ac8e57e9a82ea9a3b35c1706722b135"} Jul 07 19:14:48.161098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:48.161048 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-777c59bd5f-kdwqx" podStartSLOduration=1.738580091 podStartE2EDuration="5.161032371s" totalImagesPullingTime="3.42245228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:48.158609955 +0000 UTC m=+406.376598601" watchObservedRunningTime="2026-07-07 19:14:48.161032371 +0000 UTC m=+406.379021053" Jul 07 19:14:51.120272 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.120244 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:14:51.123667 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.123649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.126571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.126552 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kgb6k\"" Jul 07 19:14:51.127395 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.127376 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 19:14:51.143728 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143701 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.143832 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.143901 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.143968 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.143968 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143933 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.144061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.143974 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnrz\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.144061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.144000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.144061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.144023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.144214 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.144133 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.146391 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.146370 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:14:51.244661 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.244810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.244810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244694 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.244810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244720 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.244810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.244810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245111 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnrz\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245111 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245111 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.244871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245111 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.245035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245324 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.245138 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245324 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.245288 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.245430 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.245382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.246047 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.246025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.247368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.247332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.247479 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.247398 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.264744 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.264722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnrz\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.269401 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.269380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.433693 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.433671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:51.614805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.614780 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:14:51.617092 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:51.617066 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5e72b3_4101_44f7_b4f1_e179416d6648.slice/crio-406cee221aae1a40047568e019a43d5a50021e0e7dadf02bc4bfaf37ef24a1cd WatchSource:0}: Error finding container 406cee221aae1a40047568e019a43d5a50021e0e7dadf02bc4bfaf37ef24a1cd: Status 404 returned error can't find the container with id 406cee221aae1a40047568e019a43d5a50021e0e7dadf02bc4bfaf37ef24a1cd Jul 07 19:14:51.662614 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.662584 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk"] Jul 07 19:14:51.667065 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.667048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.671511 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.671488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 19:14:51.671602 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.671488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 19:14:51.672008 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.671992 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6kwhl\"" Jul 07 19:14:51.672091 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.672072 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 19:14:51.737881 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.737810 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk"] Jul 07 19:14:51.748919 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.748890 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.748923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.748955 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefbc4be-1f0f-4de4-a824-1159f3433ab3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749063 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.749038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749212 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.749076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749212 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.749138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdd9x\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-kube-api-access-xdd9x\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.749313 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.749210 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849819 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefbc4be-1f0f-4de4-a824-1159f3433ab3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.849970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.849964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdd9x\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-kube-api-access-xdd9x\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.850906 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.850876 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.852256 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.852231 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fefbc4be-1f0f-4de4-a824-1159f3433ab3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.852407 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.852389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.852511 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.852488 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.852566 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.852552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.859550 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.859527 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.859845 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.859830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdd9x\" (UniqueName: \"kubernetes.io/projected/fefbc4be-1f0f-4de4-a824-1159f3433ab3-kube-api-access-xdd9x\") pod \"istiod-openshift-gateway-94bb8fbfd-4rnqk\" (UID: \"fefbc4be-1f0f-4de4-a824-1159f3433ab3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:51.976741 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:51.976709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:52.150416 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:52.150384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk"] Jul 07 19:14:52.151072 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:14:52.151047 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefbc4be_1f0f_4de4_a824_1159f3433ab3.slice/crio-196821bf95145d9ef870b60db0b5129e45b41b740f7679fc1c9ca2fe1b52d076 WatchSource:0}: Error finding container 196821bf95145d9ef870b60db0b5129e45b41b740f7679fc1c9ca2fe1b52d076: Status 404 returned error can't find the container with id 196821bf95145d9ef870b60db0b5129e45b41b740f7679fc1c9ca2fe1b52d076 Jul 07 19:14:52.152809 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:52.152781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" event={"ID":"4c5e72b3-4101-44f7-b4f1-e179416d6648","Type":"ContainerStarted","Data":"406cee221aae1a40047568e019a43d5a50021e0e7dadf02bc4bfaf37ef24a1cd"} Jul 07 19:14:53.165363 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:53.165326 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" event={"ID":"fefbc4be-1f0f-4de4-a824-1159f3433ab3","Type":"ContainerStarted","Data":"196821bf95145d9ef870b60db0b5129e45b41b740f7679fc1c9ca2fe1b52d076"} Jul 07 19:14:55.367375 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:55.367334 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:14:55.367722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:55.367445 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:14:55.367722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:55.367502 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:14:55.368923 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:55.368893 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:14:55.369031 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:55.368945 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:14:56.187391 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.187351 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" event={"ID":"4c5e72b3-4101-44f7-b4f1-e179416d6648","Type":"ContainerStarted","Data":"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639"} Jul 07 19:14:56.188919 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.188890 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" event={"ID":"fefbc4be-1f0f-4de4-a824-1159f3433ab3","Type":"ContainerStarted","Data":"28a18513c5c5d960f5f9914c2752f085bd50632928c81898069fc668470fcfe5"} Jul 07 19:14:56.189110 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.189093 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:56.190566 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.190541 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-4rnqk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 19:14:56.190662 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.190594 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" podUID="fefbc4be-1f0f-4de4-a824-1159f3433ab3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 19:14:56.237618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.237571 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" podStartSLOduration=1.489606551 podStartE2EDuration="5.237557673s" totalImagesPullingTime="3.747951122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:56.234318584 +0000 UTC m=+414.452307220" watchObservedRunningTime="2026-07-07 19:14:56.237557673 +0000 UTC m=+414.455546309" Jul 07 19:14:56.278894 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.278851 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" podStartSLOduration=2.062955252 podStartE2EDuration="5.278837655s" totalImagesPullingTime="3.215882403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:14:56.276818523 +0000 UTC m=+414.494807159" watchObservedRunningTime="2026-07-07 19:14:56.278837655 +0000 UTC m=+414.496826291" Jul 07 19:14:56.434434 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.434400 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:14:56.435783 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.435751 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 07 19:14:56.435905 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.435806 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 07 19:14:56.598923 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:56.598848 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:14:57.195970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:57.195941 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4rnqk" Jul 07 19:14:57.434419 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:57.434388 2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 07 19:14:57.434586 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:57.434440 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 07 19:14:58.199720 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:14:58.199686 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" containerID="cri-o://aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639" gracePeriod=30 Jul 07 19:15:03.445542 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.445521 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:15:03.555236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555165 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555196 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555233 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555255 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555276 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555307 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555362 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcnrz\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555414 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555483 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket\") pod \"4c5e72b3-4101-44f7-b4f1-e179416d6648\" (UID: \"4c5e72b3-4101-44f7-b4f1-e179416d6648\") " Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555578 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555607 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555749 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-credential-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555769 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-certs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555785 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:15:03.555805 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555793 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:15:03.556034 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.555901 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:15:03.557773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.557749 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:15:03.557921 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.557903 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:15:03.557921 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.557908 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 19:15:03.558057 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.558041 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz" (OuterVolumeSpecName: "kube-api-access-bcnrz") pod "4c5e72b3-4101-44f7-b4f1-e179416d6648" (UID: "4c5e72b3-4101-44f7-b4f1-e179416d6648"). InnerVolumeSpecName "kube-api-access-bcnrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:15:03.656769 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656737 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c5e72b3-4101-44f7-b4f1-e179416d6648-istiod-ca-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656769 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656765 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcnrz\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-kube-api-access-bcnrz\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656769 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656775 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-data\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656983 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656784 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-workload-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656983 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656791 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656983 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656799 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-podinfo\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:03.656983 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:03.656806 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c5e72b3-4101-44f7-b4f1-e179416d6648-istio-envoy\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:04.227919 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.227874 2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerID="aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639" exitCode=0 Jul 07 19:15:04.228115 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.227986 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" Jul 07 19:15:04.230314 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.230291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" event={"ID":"4c5e72b3-4101-44f7-b4f1-e179416d6648","Type":"ContainerDied","Data":"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639"} Jul 07 19:15:04.230427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.230328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb" event={"ID":"4c5e72b3-4101-44f7-b4f1-e179416d6648","Type":"ContainerDied","Data":"406cee221aae1a40047568e019a43d5a50021e0e7dadf02bc4bfaf37ef24a1cd"} Jul 07 19:15:04.230427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.230351 2576 scope.go:117] "RemoveContainer" containerID="aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639" Jul 07 19:15:04.239379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.239363 2576 scope.go:117] "RemoveContainer" containerID="aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639" Jul 07 19:15:04.239669 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:15:04.239649 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639\": container with ID starting with aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639 not found: ID does not exist" containerID="aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639" Jul 07 19:15:04.239745 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.239677 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639"} err="failed to get container status \"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639\": rpc error: code = NotFound desc = could not find container \"aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639\": container with ID starting with aa863fbade23cd851af93b094b5479201c3c2123d5504f4c751074128c7f1639 not found: ID does not exist" Jul 07 19:15:04.257555 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.257533 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:15:04.263419 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:04.263384 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-q8zbb"] Jul 07 19:15:06.231740 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:06.231710 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" path="/var/lib/kubelet/pods/4c5e72b3-4101-44f7-b4f1-e179416d6648/volumes" Jul 07 19:15:44.079125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.079094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:44.079586 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.079396 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" Jul 07 19:15:44.079586 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.079406 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" Jul 07 19:15:44.079586 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.079478 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c5e72b3-4101-44f7-b4f1-e179416d6648" containerName="istio-proxy" Jul 07 19:15:44.090078 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.090051 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:44.093222 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.093193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 19:15:44.094027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.094004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9tkds\"" Jul 07 19:15:44.094162 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.094103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:44.094320 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.094302 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 19:15:44.181752 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.181721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxl5q\" (UniqueName: \"kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q\") pod \"kuadrant-operator-catalog-mmszx\" (UID: \"36f792c2-84e8-427c-aed9-f8ac70bbdd32\") " pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:44.282784 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.282755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxl5q\" (UniqueName: \"kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q\") pod \"kuadrant-operator-catalog-mmszx\" (UID: \"36f792c2-84e8-427c-aed9-f8ac70bbdd32\") " pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:44.296532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.296506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxl5q\" (UniqueName: \"kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q\") pod \"kuadrant-operator-catalog-mmszx\" (UID: \"36f792c2-84e8-427c-aed9-f8ac70bbdd32\") " pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:44.401954 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.401931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:44.427268 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.427240 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:44.533747 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.533724 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:44.536402 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:15:44.536376 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f792c2_84e8_427c_aed9_f8ac70bbdd32.slice/crio-2d9e4f124b602749f32ef8ae6e0e851c6515ab58e4810f1134c25e3af363439d WatchSource:0}: Error finding container 2d9e4f124b602749f32ef8ae6e0e851c6515ab58e4810f1134c25e3af363439d: Status 404 returned error can't find the container with id 2d9e4f124b602749f32ef8ae6e0e851c6515ab58e4810f1134c25e3af363439d Jul 07 19:15:44.637735 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.637708 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zf6lm"] Jul 07 19:15:44.640511 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.640495 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:44.649751 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.649730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zf6lm"] Jul 07 19:15:44.685308 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.685236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4hfh\" (UniqueName: \"kubernetes.io/projected/336e66dc-1815-4479-87c4-595d90b1f481-kube-api-access-q4hfh\") pod \"kuadrant-operator-catalog-zf6lm\" (UID: \"336e66dc-1815-4479-87c4-595d90b1f481\") " pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:44.785831 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.785811 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4hfh\" (UniqueName: \"kubernetes.io/projected/336e66dc-1815-4479-87c4-595d90b1f481-kube-api-access-q4hfh\") pod \"kuadrant-operator-catalog-zf6lm\" (UID: \"336e66dc-1815-4479-87c4-595d90b1f481\") " pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:44.795339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.795318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4hfh\" (UniqueName: \"kubernetes.io/projected/336e66dc-1815-4479-87c4-595d90b1f481-kube-api-access-q4hfh\") pod \"kuadrant-operator-catalog-zf6lm\" (UID: \"336e66dc-1815-4479-87c4-595d90b1f481\") " pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:44.951352 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:44.951297 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:45.099425 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:45.099368 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zf6lm"] Jul 07 19:15:45.100506 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:15:45.100482 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336e66dc_1815_4479_87c4_595d90b1f481.slice/crio-d9ab838e88b48ef8dbc68f5cb3cf2b00002cd30f4c97e4bcd49344a30a64eb45 WatchSource:0}: Error finding container d9ab838e88b48ef8dbc68f5cb3cf2b00002cd30f4c97e4bcd49344a30a64eb45: Status 404 returned error can't find the container with id d9ab838e88b48ef8dbc68f5cb3cf2b00002cd30f4c97e4bcd49344a30a64eb45 Jul 07 19:15:45.416727 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:45.416690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" event={"ID":"336e66dc-1815-4479-87c4-595d90b1f481","Type":"ContainerStarted","Data":"d9ab838e88b48ef8dbc68f5cb3cf2b00002cd30f4c97e4bcd49344a30a64eb45"} Jul 07 19:15:45.418046 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:45.418010 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" event={"ID":"36f792c2-84e8-427c-aed9-f8ac70bbdd32","Type":"ContainerStarted","Data":"2d9e4f124b602749f32ef8ae6e0e851c6515ab58e4810f1134c25e3af363439d"} Jul 07 19:15:47.429695 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.429653 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" event={"ID":"336e66dc-1815-4479-87c4-595d90b1f481","Type":"ContainerStarted","Data":"9ff7d2bc280cbb9f071b8e9474cc994c82549d0159e6722794c8f140d0c37be6"} Jul 07 19:15:47.431162 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.431135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" event={"ID":"36f792c2-84e8-427c-aed9-f8ac70bbdd32","Type":"ContainerStarted","Data":"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909"} Jul 07 19:15:47.431271 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.431234 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" podUID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" containerName="registry-server" containerID="cri-o://260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909" gracePeriod=2 Jul 07 19:15:47.449954 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.449914 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" podStartSLOduration=2.158418065 podStartE2EDuration="3.449899556s" totalImagesPullingTime="1.291481491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:47.447860671 +0000 UTC m=+465.665849307" watchObservedRunningTime="2026-07-07 19:15:47.449899556 +0000 UTC m=+465.667888195" Jul 07 19:15:47.465751 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.465705 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" podStartSLOduration=1.610939124 podStartE2EDuration="3.465691163s" totalImagesPullingTime="1.854752039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:47.464877042 +0000 UTC m=+465.682865678" watchObservedRunningTime="2026-07-07 19:15:47.465691163 +0000 UTC m=+465.683679798" Jul 07 19:15:47.679025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.679003 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:47.707326 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.707268 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxl5q\" (UniqueName: \"kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q\") pod \"36f792c2-84e8-427c-aed9-f8ac70bbdd32\" (UID: \"36f792c2-84e8-427c-aed9-f8ac70bbdd32\") " Jul 07 19:15:47.709525 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.709500 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q" (OuterVolumeSpecName: "kube-api-access-xxl5q") pod "36f792c2-84e8-427c-aed9-f8ac70bbdd32" (UID: "36f792c2-84e8-427c-aed9-f8ac70bbdd32"). InnerVolumeSpecName "kube-api-access-xxl5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:15:47.807835 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:47.807811 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxl5q\" (UniqueName: \"kubernetes.io/projected/36f792c2-84e8-427c-aed9-f8ac70bbdd32-kube-api-access-xxl5q\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:15:48.437013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.436978 2576 generic.go:356] "Generic (PLEG): container finished" podID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" containerID="260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909" exitCode=0 Jul 07 19:15:48.437507 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.437023 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" Jul 07 19:15:48.437507 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.437059 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" event={"ID":"36f792c2-84e8-427c-aed9-f8ac70bbdd32","Type":"ContainerDied","Data":"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909"} Jul 07 19:15:48.437507 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.437113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmszx" event={"ID":"36f792c2-84e8-427c-aed9-f8ac70bbdd32","Type":"ContainerDied","Data":"2d9e4f124b602749f32ef8ae6e0e851c6515ab58e4810f1134c25e3af363439d"} Jul 07 19:15:48.437507 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.437134 2576 scope.go:117] "RemoveContainer" containerID="260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909" Jul 07 19:15:48.446257 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.446243 2576 scope.go:117] "RemoveContainer" containerID="260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909" Jul 07 19:15:48.446526 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:15:48.446510 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909\": container with ID starting with 260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909 not found: ID does not exist" containerID="260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909" Jul 07 19:15:48.446590 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.446532 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909"} err="failed to get container status \"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909\": rpc error: code = NotFound desc = could not find container \"260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909\": container with ID starting with 260e766158c82651f75fc19fe82776bb21c187ab33828fe8d0fe3b7bf9309909 not found: ID does not exist" Jul 07 19:15:48.473303 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.468120 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:48.485254 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:48.485222 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmszx"] Jul 07 19:15:50.229381 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:50.229351 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" path="/var/lib/kubelet/pods/36f792c2-84e8-427c-aed9-f8ac70bbdd32/volumes" Jul 07 19:15:54.951568 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:54.951536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:54.952047 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:54.951595 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:54.974340 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:54.974318 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:55.492645 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:55.492617 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zf6lm" Jul 07 19:15:59.472536 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.472507 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr"] Jul 07 19:15:59.472901 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.472796 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" containerName="registry-server" Jul 07 19:15:59.472901 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.472806 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" containerName="registry-server" Jul 07 19:15:59.472901 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.472866 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36f792c2-84e8-427c-aed9-f8ac70bbdd32" containerName="registry-server" Jul 07 19:15:59.476075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.476056 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.478906 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.478878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6d87x\"" Jul 07 19:15:59.487601 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.487580 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr"] Jul 07 19:15:59.491125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.491106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.491227 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.491160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znprp\" (UniqueName: \"kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.491227 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.491197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.592058 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.592031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znprp\" (UniqueName: \"kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.592201 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.592070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.592201 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.592098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.592397 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.592383 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.592490 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.592445 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.601211 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.601183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znprp\" (UniqueName: \"kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.784849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.784775 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:15:59.918673 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:15:59.918643 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr"] Jul 07 19:15:59.921759 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:15:59.921730 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72e512d_2608_4a0b_b5f8_843d6e702bab.slice/crio-ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43 WatchSource:0}: Error finding container ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43: Status 404 returned error can't find the container with id ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43 Jul 07 19:16:00.075532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.075461 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck"] Jul 07 19:16:00.078845 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.078821 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.089888 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.089863 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck"] Jul 07 19:16:00.096334 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.096309 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgfxl\" (UniqueName: \"kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.096435 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.096381 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.096435 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.096425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.197770 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.197740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.197930 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.197782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.197930 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.197832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgfxl\" (UniqueName: \"kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.198098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.198079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.198137 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.198105 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.207348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.207324 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgfxl\" (UniqueName: \"kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.388230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.388185 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:00.478095 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.476435 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf"] Jul 07 19:16:00.481747 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.481723 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.495896 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.495849 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf"] Jul 07 19:16:00.498224 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.498181 2576 generic.go:356] "Generic (PLEG): container finished" podID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerID="abb4c3e93d82b3bdd058a0719fa6175e303fbb7902ef303cde574ee4cf014f60" exitCode=0 Jul 07 19:16:00.498323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.498261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" event={"ID":"a72e512d-2608-4a0b-b5f8-843d6e702bab","Type":"ContainerDied","Data":"abb4c3e93d82b3bdd058a0719fa6175e303fbb7902ef303cde574ee4cf014f60"} Jul 07 19:16:00.498323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.498311 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" event={"ID":"a72e512d-2608-4a0b-b5f8-843d6e702bab","Type":"ContainerStarted","Data":"ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43"} Jul 07 19:16:00.500573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.500544 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfczv\" (UniqueName: \"kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.500679 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.500620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.500679 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.500663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.531150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.531127 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck"] Jul 07 19:16:00.533579 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:00.533554 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6b0aac_dcc2_42bd_bd79_1d4dc36871b6.slice/crio-c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d WatchSource:0}: Error finding container c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d: Status 404 returned error can't find the container with id c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d Jul 07 19:16:00.601127 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.601100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.601268 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.601149 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.601268 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.601212 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfczv\" (UniqueName: \"kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.601607 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.601584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.601654 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.601603 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.611476 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.611415 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfczv\" (UniqueName: \"kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.793624 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.793559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:00.875237 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.875210 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx"] Jul 07 19:16:00.879872 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.879851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:00.892088 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.892065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx"] Jul 07 19:16:00.903489 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.903447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:00.903755 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.903733 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:00.903932 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.903914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r85rm\" (UniqueName: \"kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:00.943446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:00.943383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf"] Jul 07 19:16:00.945576 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:00.945553 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07302bd1_408b_4e44_85a8_3708b9eda52b.slice/crio-e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651 WatchSource:0}: Error finding container e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651: Status 404 returned error can't find the container with id e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651 Jul 07 19:16:01.004634 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.004603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.004737 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.004652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.004737 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.004682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r85rm\" (UniqueName: \"kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.005002 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.004980 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.005084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.005065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.016817 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.016787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r85rm\" (UniqueName: \"kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.192760 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.192726 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:01.334308 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.334281 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx"] Jul 07 19:16:01.392594 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:01.392560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e325d4_173e_4378_87bc_6191ff25f1cc.slice/crio-f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e WatchSource:0}: Error finding container f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e: Status 404 returned error can't find the container with id f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e Jul 07 19:16:01.507868 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.507836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" event={"ID":"d8e325d4-173e-4378-87bc-6191ff25f1cc","Type":"ContainerStarted","Data":"f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e"} Jul 07 19:16:01.509502 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.509478 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerID="178a13cb48ec66649af0fc1d288b6cf71107fe96cfa770490f5c825666f92483" exitCode=0 Jul 07 19:16:01.509636 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.509596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" event={"ID":"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6","Type":"ContainerDied","Data":"178a13cb48ec66649af0fc1d288b6cf71107fe96cfa770490f5c825666f92483"} Jul 07 19:16:01.509709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.509648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" event={"ID":"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6","Type":"ContainerStarted","Data":"c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d"} Jul 07 19:16:01.511249 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.511221 2576 generic.go:356] "Generic (PLEG): container finished" podID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerID="a030ed15fbb0cbd830605904fc69249f7c16325f386fd964725354b557c9563f" exitCode=0 Jul 07 19:16:01.511347 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.511309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" event={"ID":"07302bd1-408b-4e44-85a8-3708b9eda52b","Type":"ContainerDied","Data":"a030ed15fbb0cbd830605904fc69249f7c16325f386fd964725354b557c9563f"} Jul 07 19:16:01.511393 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:01.511357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" event={"ID":"07302bd1-408b-4e44-85a8-3708b9eda52b","Type":"ContainerStarted","Data":"e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651"} Jul 07 19:16:02.518141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.518110 2576 generic.go:356] "Generic (PLEG): container finished" podID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerID="9ab53d9005018b7cb48b3a82bcea7e695076ee155db7641e5eb175287d63da03" exitCode=0 Jul 07 19:16:02.518545 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.518183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" event={"ID":"a72e512d-2608-4a0b-b5f8-843d6e702bab","Type":"ContainerDied","Data":"9ab53d9005018b7cb48b3a82bcea7e695076ee155db7641e5eb175287d63da03"} Jul 07 19:16:02.525804 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.525776 2576 generic.go:356] "Generic (PLEG): container finished" podID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerID="5dd639401181d34d06d5bad16f545109f1e9b8e20477487273bf273fd06b4962" exitCode=0 Jul 07 19:16:02.525915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.525861 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" event={"ID":"d8e325d4-173e-4378-87bc-6191ff25f1cc","Type":"ContainerDied","Data":"5dd639401181d34d06d5bad16f545109f1e9b8e20477487273bf273fd06b4962"} Jul 07 19:16:02.528148 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.528105 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerID="c806f66b64747603730f851b09f063752fd93d3ae8f329eaa84607981f2636f0" exitCode=0 Jul 07 19:16:02.528214 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.528195 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" event={"ID":"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6","Type":"ContainerDied","Data":"c806f66b64747603730f851b09f063752fd93d3ae8f329eaa84607981f2636f0"} Jul 07 19:16:02.530822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.530800 2576 generic.go:356] "Generic (PLEG): container finished" podID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerID="1e20ab3d527db4a81f14d86148b5acdfc196e7af22987ae021957dad8034db2d" exitCode=0 Jul 07 19:16:02.530912 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:02.530885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" event={"ID":"07302bd1-408b-4e44-85a8-3708b9eda52b","Type":"ContainerDied","Data":"1e20ab3d527db4a81f14d86148b5acdfc196e7af22987ae021957dad8034db2d"} Jul 07 19:16:03.538043 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.538011 2576 generic.go:356] "Generic (PLEG): container finished" podID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerID="e996efe00bb9cb9204f50c963e0a4e14e631c518f53e55520e6545c5a0a9294b" exitCode=0 Jul 07 19:16:03.538415 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.538096 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" event={"ID":"a72e512d-2608-4a0b-b5f8-843d6e702bab","Type":"ContainerDied","Data":"e996efe00bb9cb9204f50c963e0a4e14e631c518f53e55520e6545c5a0a9294b"} Jul 07 19:16:03.539869 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.539849 2576 generic.go:356] "Generic (PLEG): container finished" podID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerID="e9d275eaf883c506d1a67f67a9dd05aac93df505a588fa5fe329ddfe5d1955ee" exitCode=0 Jul 07 19:16:03.539955 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.539917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" event={"ID":"d8e325d4-173e-4378-87bc-6191ff25f1cc","Type":"ContainerDied","Data":"e9d275eaf883c506d1a67f67a9dd05aac93df505a588fa5fe329ddfe5d1955ee"} Jul 07 19:16:03.542058 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.542036 2576 generic.go:356] "Generic (PLEG): container finished" podID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerID="2972b2950222f191414c3bde698992c358b0274c8662df5de98f8eb56aaef6cd" exitCode=0 Jul 07 19:16:03.542147 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.542062 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" event={"ID":"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6","Type":"ContainerDied","Data":"2972b2950222f191414c3bde698992c358b0274c8662df5de98f8eb56aaef6cd"} Jul 07 19:16:03.544025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.544006 2576 generic.go:356] "Generic (PLEG): container finished" podID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerID="5248b2cee46e33434eb6728e89974bfa82002dd2b3210535aa7124c025e638e5" exitCode=0 Jul 07 19:16:03.544096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:03.544043 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" event={"ID":"07302bd1-408b-4e44-85a8-3708b9eda52b","Type":"ContainerDied","Data":"5248b2cee46e33434eb6728e89974bfa82002dd2b3210535aa7124c025e638e5"} Jul 07 19:16:04.551352 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.551316 2576 generic.go:356] "Generic (PLEG): container finished" podID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerID="46f50e8722d4363cd87b756534639805bb8a4469fae7ac21ef61e952b9e28fc2" exitCode=0 Jul 07 19:16:04.551792 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.551399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" event={"ID":"d8e325d4-173e-4378-87bc-6191ff25f1cc","Type":"ContainerDied","Data":"46f50e8722d4363cd87b756534639805bb8a4469fae7ac21ef61e952b9e28fc2"} Jul 07 19:16:04.730842 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.730822 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:04.733154 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.733134 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:16:04.761057 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.761040 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:04.836638 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836505 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfczv\" (UniqueName: \"kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv\") pod \"07302bd1-408b-4e44-85a8-3708b9eda52b\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " Jul 07 19:16:04.836638 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util\") pod \"a72e512d-2608-4a0b-b5f8-843d6e702bab\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836644 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle\") pod \"a72e512d-2608-4a0b-b5f8-843d6e702bab\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836668 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util\") pod \"07302bd1-408b-4e44-85a8-3708b9eda52b\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836694 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle\") pod \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836751 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util\") pod \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836791 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgfxl\" (UniqueName: \"kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl\") pod \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\" (UID: \"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6\") " Jul 07 19:16:04.836847 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znprp\" (UniqueName: \"kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp\") pod \"a72e512d-2608-4a0b-b5f8-843d6e702bab\" (UID: \"a72e512d-2608-4a0b-b5f8-843d6e702bab\") " Jul 07 19:16:04.837212 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.836857 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle\") pod \"07302bd1-408b-4e44-85a8-3708b9eda52b\" (UID: \"07302bd1-408b-4e44-85a8-3708b9eda52b\") " Jul 07 19:16:04.837433 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.837401 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle" (OuterVolumeSpecName: "bundle") pod "a72e512d-2608-4a0b-b5f8-843d6e702bab" (UID: "a72e512d-2608-4a0b-b5f8-843d6e702bab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.837552 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.837531 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle" (OuterVolumeSpecName: "bundle") pod "07302bd1-408b-4e44-85a8-3708b9eda52b" (UID: "07302bd1-408b-4e44-85a8-3708b9eda52b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.837636 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.837608 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle" (OuterVolumeSpecName: "bundle") pod "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" (UID: "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.840211 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.840156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp" (OuterVolumeSpecName: "kube-api-access-znprp") pod "a72e512d-2608-4a0b-b5f8-843d6e702bab" (UID: "a72e512d-2608-4a0b-b5f8-843d6e702bab"). InnerVolumeSpecName "kube-api-access-znprp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:16:04.840211 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.840175 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv" (OuterVolumeSpecName: "kube-api-access-cfczv") pod "07302bd1-408b-4e44-85a8-3708b9eda52b" (UID: "07302bd1-408b-4e44-85a8-3708b9eda52b"). InnerVolumeSpecName "kube-api-access-cfczv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:16:04.840211 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.840196 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl" (OuterVolumeSpecName: "kube-api-access-rgfxl") pod "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" (UID: "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6"). InnerVolumeSpecName "kube-api-access-rgfxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:16:04.844576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.844534 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util" (OuterVolumeSpecName: "util") pod "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" (UID: "3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.846169 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.846142 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util" (OuterVolumeSpecName: "util") pod "a72e512d-2608-4a0b-b5f8-843d6e702bab" (UID: "a72e512d-2608-4a0b-b5f8-843d6e702bab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.846300 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.846283 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util" (OuterVolumeSpecName: "util") pod "07302bd1-408b-4e44-85a8-3708b9eda52b" (UID: "07302bd1-408b-4e44-85a8-3708b9eda52b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:04.937967 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937943 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfczv\" (UniqueName: \"kubernetes.io/projected/07302bd1-408b-4e44-85a8-3708b9eda52b-kube-api-access-cfczv\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.937967 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937965 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937976 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a72e512d-2608-4a0b-b5f8-843d6e702bab-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937983 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937991 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.937998 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.938005 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgfxl\" (UniqueName: \"kubernetes.io/projected/3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6-kube-api-access-rgfxl\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.938014 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znprp\" (UniqueName: \"kubernetes.io/projected/a72e512d-2608-4a0b-b5f8-843d6e702bab-kube-api-access-znprp\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:04.938094 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:04.938022 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07302bd1-408b-4e44-85a8-3708b9eda52b-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:05.558709 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.558684 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" Jul 07 19:16:05.559098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.558684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr" event={"ID":"a72e512d-2608-4a0b-b5f8-843d6e702bab","Type":"ContainerDied","Data":"ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43"} Jul 07 19:16:05.559098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.558811 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba5bc41e95c0d489d739afab0a8837cf09bc1db869c337d01c45b9d02babaf43" Jul 07 19:16:05.560568 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.560548 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" Jul 07 19:16:05.560710 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.560582 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck" event={"ID":"3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6","Type":"ContainerDied","Data":"c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d"} Jul 07 19:16:05.560710 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.560626 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9f9b6a52ae70454dac4ec245d347e9d414d11b9e0b7d28a7405c8504b4f166d" Jul 07 19:16:05.562676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.562660 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" Jul 07 19:16:05.562774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.562692 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf" event={"ID":"07302bd1-408b-4e44-85a8-3708b9eda52b","Type":"ContainerDied","Data":"e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651"} Jul 07 19:16:05.562774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.562740 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0a49ed8b11db5dbfe98998b6d6def83bac250053594d575b3072728a9737651" Jul 07 19:16:05.684356 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.684333 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:05.745080 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.745055 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util\") pod \"d8e325d4-173e-4378-87bc-6191ff25f1cc\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " Jul 07 19:16:05.745198 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.745154 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r85rm\" (UniqueName: \"kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm\") pod \"d8e325d4-173e-4378-87bc-6191ff25f1cc\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " Jul 07 19:16:05.745198 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.745179 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle\") pod \"d8e325d4-173e-4378-87bc-6191ff25f1cc\" (UID: \"d8e325d4-173e-4378-87bc-6191ff25f1cc\") " Jul 07 19:16:05.745822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.745790 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle" (OuterVolumeSpecName: "bundle") pod "d8e325d4-173e-4378-87bc-6191ff25f1cc" (UID: "d8e325d4-173e-4378-87bc-6191ff25f1cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:05.747261 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.747241 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm" (OuterVolumeSpecName: "kube-api-access-r85rm") pod "d8e325d4-173e-4378-87bc-6191ff25f1cc" (UID: "d8e325d4-173e-4378-87bc-6191ff25f1cc"). InnerVolumeSpecName "kube-api-access-r85rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:16:05.753013 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.752991 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util" (OuterVolumeSpecName: "util") pod "d8e325d4-173e-4378-87bc-6191ff25f1cc" (UID: "d8e325d4-173e-4378-87bc-6191ff25f1cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:16:05.845902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.845834 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r85rm\" (UniqueName: \"kubernetes.io/projected/d8e325d4-173e-4378-87bc-6191ff25f1cc-kube-api-access-r85rm\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:05.845902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.845857 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:05.845902 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:05.845866 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8e325d4-173e-4378-87bc-6191ff25f1cc-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:06.569589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:06.569503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" event={"ID":"d8e325d4-173e-4378-87bc-6191ff25f1cc","Type":"ContainerDied","Data":"f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e"} Jul 07 19:16:06.569589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:06.569555 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5738206a2389cdc03fc6c05d83051b1a854c3edb85988efccd2a573aaaacd7e" Jul 07 19:16:06.569589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:06.569519 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx" Jul 07 19:16:15.488096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488066 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh"] Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488404 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488416 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488428 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488435 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488467 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488475 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488486 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488493 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488499 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488504 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488513 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488518 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488526 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488531 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488538 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488543 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488550 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488555 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488561 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488566 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="util" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488571 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488575 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="extract" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488584 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="pull" Jul 07 19:16:15.488576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488588 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="pull" Jul 07 19:16:15.489304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488646 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07302bd1-408b-4e44-85a8-3708b9eda52b" containerName="extract" Jul 07 19:16:15.489304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488653 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72e512d-2608-4a0b-b5f8-843d6e702bab" containerName="extract" Jul 07 19:16:15.489304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488660 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8e325d4-173e-4378-87bc-6191ff25f1cc" containerName="extract" Jul 07 19:16:15.489304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.488666 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6" containerName="extract" Jul 07 19:16:15.493297 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.493273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:15.496176 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.496160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ggpzx\"" Jul 07 19:16:15.504859 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.504835 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh"] Jul 07 19:16:15.526308 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.526287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbtxw\" (UniqueName: \"kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw\") pod \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" (UID: \"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:15.626903 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.626872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbtxw\" (UniqueName: \"kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw\") pod \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" (UID: \"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:15.637705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.637681 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbtxw\" (UniqueName: \"kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw\") pod \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" (UID: \"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:15.803822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.803745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:15.964521 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:15.962873 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh"] Jul 07 19:16:15.966868 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:15.966831 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebcb3b8_ce59_4de9_9a5e_fb2b3996595b.slice/crio-52cdf1ca37cdad66752a66cbc0b2f8cfec7fc420e05d63f26b5980a7839700fa WatchSource:0}: Error finding container 52cdf1ca37cdad66752a66cbc0b2f8cfec7fc420e05d63f26b5980a7839700fa: Status 404 returned error can't find the container with id 52cdf1ca37cdad66752a66cbc0b2f8cfec7fc420e05d63f26b5980a7839700fa Jul 07 19:16:16.634849 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:16.634812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" event={"ID":"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b","Type":"ContainerStarted","Data":"52cdf1ca37cdad66752a66cbc0b2f8cfec7fc420e05d63f26b5980a7839700fa"} Jul 07 19:16:18.645853 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:18.645796 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" event={"ID":"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b","Type":"ContainerStarted","Data":"cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc"} Jul 07 19:16:18.646301 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:18.645921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:18.669375 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:18.669324 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" podStartSLOduration=1.6907192800000002 podStartE2EDuration="3.669309504s" totalImagesPullingTime="1.978590224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:16:18.667591962 +0000 UTC m=+496.885580597" watchObservedRunningTime="2026-07-07 19:16:18.669309504 +0000 UTC m=+496.887298141" Jul 07 19:16:23.394781 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.394747 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx"] Jul 07 19:16:23.401178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.401148 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:23.408998 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.408980 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-cm58b\"" Jul 07 19:16:23.413477 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.413436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx"] Jul 07 19:16:23.490486 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.490435 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrclp\" (UniqueName: \"kubernetes.io/projected/ee129719-5804-42fc-bd7f-df8e32022568-kube-api-access-rrclp\") pod \"authorino-operator-75cc8d5cb7-mw9mx\" (UID: \"ee129719-5804-42fc-bd7f-df8e32022568\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:23.591174 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.591141 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrclp\" (UniqueName: \"kubernetes.io/projected/ee129719-5804-42fc-bd7f-df8e32022568-kube-api-access-rrclp\") pod \"authorino-operator-75cc8d5cb7-mw9mx\" (UID: \"ee129719-5804-42fc-bd7f-df8e32022568\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:23.615236 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.615209 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrclp\" (UniqueName: \"kubernetes.io/projected/ee129719-5804-42fc-bd7f-df8e32022568-kube-api-access-rrclp\") pod \"authorino-operator-75cc8d5cb7-mw9mx\" (UID: \"ee129719-5804-42fc-bd7f-df8e32022568\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:23.712098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.712020 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:23.851591 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:23.851569 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx"] Jul 07 19:16:23.853624 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:23.853593 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee129719_5804_42fc_bd7f_df8e32022568.slice/crio-77aa874fcb8d4c7ef7353eb69c09c8da93ea12b13eb52b1fc9c29dc1e61843e0 WatchSource:0}: Error finding container 77aa874fcb8d4c7ef7353eb69c09c8da93ea12b13eb52b1fc9c29dc1e61843e0: Status 404 returned error can't find the container with id 77aa874fcb8d4c7ef7353eb69c09c8da93ea12b13eb52b1fc9c29dc1e61843e0 Jul 07 19:16:24.676151 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:24.676116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" event={"ID":"ee129719-5804-42fc-bd7f-df8e32022568","Type":"ContainerStarted","Data":"77aa874fcb8d4c7ef7353eb69c09c8da93ea12b13eb52b1fc9c29dc1e61843e0"} Jul 07 19:16:27.693018 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:27.692984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" event={"ID":"ee129719-5804-42fc-bd7f-df8e32022568","Type":"ContainerStarted","Data":"f58290c749b71117051b0e57dcc7ed8d005eb282ae356541af33754fbcb536d3"} Jul 07 19:16:27.693387 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:27.693075 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:27.748356 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:27.748310 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" podStartSLOduration=1.950844398 podStartE2EDuration="4.748295516s" totalImagesPullingTime="2.797451118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:16:27.746581562 +0000 UTC m=+505.964570199" watchObservedRunningTime="2026-07-07 19:16:27.748295516 +0000 UTC m=+505.966284153" Jul 07 19:16:29.652850 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:29.652823 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:38.701195 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:38.701163 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mw9mx" Jul 07 19:16:41.798343 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.798312 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh"] Jul 07 19:16:41.798747 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.798541 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" containerName="manager" containerID="cri-o://cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc" gracePeriod=2 Jul 07 19:16:41.805729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.805699 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh"] Jul 07 19:16:41.836358 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.836330 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh"] Jul 07 19:16:41.836713 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.836699 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" containerName="manager" Jul 07 19:16:41.836780 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.836715 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" containerName="manager" Jul 07 19:16:41.836837 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.836787 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" containerName="manager" Jul 07 19:16:41.839745 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.839725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:41.842585 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:16:41.842555 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:41.853327 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.853267 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh"] Jul 07 19:16:41.939830 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:41.939802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qw7t\" (UniqueName: \"kubernetes.io/projected/f40cba10-c4eb-4268-9a77-af182e439933-kube-api-access-6qw7t\") pod \"limitador-operator-controller-manager-859d7b78bd-7flwh\" (UID: \"f40cba10-c4eb-4268-9a77-af182e439933\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:42.039079 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.039055 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:42.040319 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.040294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qw7t\" (UniqueName: \"kubernetes.io/projected/f40cba10-c4eb-4268-9a77-af182e439933-kube-api-access-6qw7t\") pod \"limitador-operator-controller-manager-859d7b78bd-7flwh\" (UID: \"f40cba10-c4eb-4268-9a77-af182e439933\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:42.041678 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:16:42.041653 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:42.050573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.050528 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qw7t\" (UniqueName: \"kubernetes.io/projected/f40cba10-c4eb-4268-9a77-af182e439933-kube-api-access-6qw7t\") pod \"limitador-operator-controller-manager-859d7b78bd-7flwh\" (UID: \"f40cba10-c4eb-4268-9a77-af182e439933\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:42.141472 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.141424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbtxw\" (UniqueName: \"kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw\") pod \"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b\" (UID: \"7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b\") " Jul 07 19:16:42.143580 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.143551 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw" (OuterVolumeSpecName: "kube-api-access-lbtxw") pod "7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" (UID: "7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b"). InnerVolumeSpecName "kube-api-access-lbtxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:16:42.179952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.179926 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:42.229959 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:16:42.229925 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ppjrh\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:42.231969 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.231943 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" path="/var/lib/kubelet/pods/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b/volumes" Jul 07 19:16:42.242656 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.242628 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbtxw\" (UniqueName: \"kubernetes.io/projected/7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b-kube-api-access-lbtxw\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:16:42.327769 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.327747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh"] Jul 07 19:16:42.329773 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:16:42.329745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40cba10_c4eb_4268_9a77_af182e439933.slice/crio-bc5f2f20ab3c1b3b1435c2d76b966bdedab28e33e206184fe64cc6b99c8cf2db WatchSource:0}: Error finding container bc5f2f20ab3c1b3b1435c2d76b966bdedab28e33e206184fe64cc6b99c8cf2db: Status 404 returned error can't find the container with id bc5f2f20ab3c1b3b1435c2d76b966bdedab28e33e206184fe64cc6b99c8cf2db Jul 07 19:16:42.772582 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.772543 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" event={"ID":"f40cba10-c4eb-4268-9a77-af182e439933","Type":"ContainerStarted","Data":"c1daf483a0329b056499ce29568500a6582c3593185798bbe7a03c5f6ef05d02"} Jul 07 19:16:42.772791 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.772606 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:16:42.772791 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.772630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" event={"ID":"f40cba10-c4eb-4268-9a77-af182e439933","Type":"ContainerStarted","Data":"bc5f2f20ab3c1b3b1435c2d76b966bdedab28e33e206184fe64cc6b99c8cf2db"} Jul 07 19:16:42.773797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.773775 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ebcb3b8-ce59-4de9-9a5e-fb2b3996595b" containerID="cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc" exitCode=0 Jul 07 19:16:42.773894 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.773808 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ppjrh" Jul 07 19:16:42.773894 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.773815 2576 scope.go:117] "RemoveContainer" containerID="cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc" Jul 07 19:16:42.782771 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.782753 2576 scope.go:117] "RemoveContainer" containerID="cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc" Jul 07 19:16:42.783025 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:16:42.783007 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc\": container with ID starting with cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc not found: ID does not exist" containerID="cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc" Jul 07 19:16:42.783092 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.783036 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc"} err="failed to get container status \"cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc\": rpc error: code = NotFound desc = could not find container \"cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc\": container with ID starting with cd6147202d6aefc2de5e409438272bad5aeb2a53c676cac4bbfd31ac1d9d75dc not found: ID does not exist" Jul 07 19:16:42.810752 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:42.810699 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" podStartSLOduration=1.810677034 podStartE2EDuration="1.810677034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:16:42.810196776 +0000 UTC m=+521.028185411" watchObservedRunningTime="2026-07-07 19:16:42.810677034 +0000 UTC m=+521.028665670" Jul 07 19:16:53.788593 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:16:53.788521 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7flwh" Jul 07 19:17:13.865534 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.865501 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:17:13.872502 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.872482 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.875395 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.875374 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 19:17:13.875717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.875405 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6d87x\"" Jul 07 19:17:13.879115 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.879095 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:17:13.881306 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.881285 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98dv5\" (UniqueName: \"kubernetes.io/projected/643e4847-5714-4f7c-a6e6-79fdd71c199c-kube-api-access-98dv5\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.881414 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.881320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643e4847-5714-4f7c-a6e6-79fdd71c199c-config-file\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.914809 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.914785 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:17:13.981923 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.981897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98dv5\" (UniqueName: \"kubernetes.io/projected/643e4847-5714-4f7c-a6e6-79fdd71c199c-kube-api-access-98dv5\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.982048 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.981931 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643e4847-5714-4f7c-a6e6-79fdd71c199c-config-file\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.982504 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.982482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/643e4847-5714-4f7c-a6e6-79fdd71c199c-config-file\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:13.991602 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:13.991581 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98dv5\" (UniqueName: \"kubernetes.io/projected/643e4847-5714-4f7c-a6e6-79fdd71c199c-kube-api-access-98dv5\") pod \"limitador-limitador-54d6d988d5-fzml6\" (UID: \"643e4847-5714-4f7c-a6e6-79fdd71c199c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:14.183120 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:14.183080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:14.339966 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:14.339933 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:17:14.342876 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:17:14.342848 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643e4847_5714_4f7c_a6e6_79fdd71c199c.slice/crio-4c7dd6a919f6c90329cdbd9a17f695f5476559b2aa619257447ec2460a9b89ab WatchSource:0}: Error finding container 4c7dd6a919f6c90329cdbd9a17f695f5476559b2aa619257447ec2460a9b89ab: Status 404 returned error can't find the container with id 4c7dd6a919f6c90329cdbd9a17f695f5476559b2aa619257447ec2460a9b89ab Jul 07 19:17:14.955089 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:14.955011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" event={"ID":"643e4847-5714-4f7c-a6e6-79fdd71c199c","Type":"ContainerStarted","Data":"4c7dd6a919f6c90329cdbd9a17f695f5476559b2aa619257447ec2460a9b89ab"} Jul 07 19:17:17.972926 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:17.972888 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" event={"ID":"643e4847-5714-4f7c-a6e6-79fdd71c199c","Type":"ContainerStarted","Data":"0f3b410210a85bf5e7add3bfb9c29199226fdf20fca50459a50801052510becb"} Jul 07 19:17:17.973335 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:17.972971 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:17:17.994760 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:17.994713 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" podStartSLOduration=2.093714901 podStartE2EDuration="4.99469807s" totalImagesPullingTime="2.900983169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:17:17.993295739 +0000 UTC m=+556.211284381" watchObservedRunningTime="2026-07-07 19:17:17.99469807 +0000 UTC m=+556.212686705" Jul 07 19:17:28.979271 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:17:28.979234 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fzml6" Jul 07 19:18:02.142398 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:02.142372 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:18:02.150801 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:02.150779 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:18:30.822225 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:30.822129 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:18:47.560258 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:47.560225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:18:52.273359 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:52.273325 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:18:58.773009 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.772975 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz"] Jul 07 19:18:58.776305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.776290 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.779163 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.779143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 19:18:58.780190 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.780170 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 07 19:18:58.780343 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.780174 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 19:18:58.780418 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.780214 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n7c64\"" Jul 07 19:18:58.784067 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.784047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz"] Jul 07 19:18:58.921065 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b402143d-3688-453f-a985-642bcb221195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.921291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.921291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.921291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921145 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsvnd\" (UniqueName: \"kubernetes.io/projected/b402143d-3688-453f-a985-642bcb221195-kube-api-access-xsvnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.921291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921205 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:58.921291 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:58.921232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022024 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsvnd\" (UniqueName: \"kubernetes.io/projected/b402143d-3688-453f-a985-642bcb221195-kube-api-access-xsvnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022127 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b402143d-3688-453f-a985-642bcb221195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022514 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022416 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022633 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.022688 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.022620 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.024531 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.024476 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b402143d-3688-453f-a985-642bcb221195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.024773 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.024757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b402143d-3688-453f-a985-642bcb221195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.031675 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.031656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsvnd\" (UniqueName: \"kubernetes.io/projected/b402143d-3688-453f-a985-642bcb221195-kube-api-access-xsvnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nsxbz\" (UID: \"b402143d-3688-453f-a985-642bcb221195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.087966 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.087938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:18:59.239577 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:18:59.239542 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb402143d_3688_453f_a985_642bcb221195.slice/crio-a16f6d7434a72bb58fa684f5ec04467767c4b0cc2d011f4dc52febbbdf71fc94 WatchSource:0}: Error finding container a16f6d7434a72bb58fa684f5ec04467767c4b0cc2d011f4dc52febbbdf71fc94: Status 404 returned error can't find the container with id a16f6d7434a72bb58fa684f5ec04467767c4b0cc2d011f4dc52febbbdf71fc94 Jul 07 19:18:59.240964 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.240946 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:18:59.242357 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.242338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz"] Jul 07 19:18:59.498044 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:18:59.498009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" event={"ID":"b402143d-3688-453f-a985-642bcb221195","Type":"ContainerStarted","Data":"a16f6d7434a72bb58fa684f5ec04467767c4b0cc2d011f4dc52febbbdf71fc94"} Jul 07 19:19:00.063641 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:00.063604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:19:00.504208 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:00.504176 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" event={"ID":"b402143d-3688-453f-a985-642bcb221195","Type":"ContainerStarted","Data":"04194e4558609ff62f9830ee343eff9e1c46665009b8aeb40919ebfa1044098d"} Jul 07 19:19:00.530085 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:00.530041 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" podStartSLOduration=1.506491205 podStartE2EDuration="2.53002149s" totalImagesPullingTime="1.023530285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:00.52900182 +0000 UTC m=+658.746990448" watchObservedRunningTime="2026-07-07 19:19:00.53002149 +0000 UTC m=+658.748010127" Jul 07 19:19:02.555117 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.555081 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt"] Jul 07 19:19:02.558959 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.558938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.561884 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.561865 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 07 19:19:02.581128 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.581103 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt"] Jul 07 19:19:02.654499 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.654643 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654519 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.654643 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6slnd\" (UniqueName: \"kubernetes.io/projected/233e5c17-9793-4e0b-beb7-e905382f17d4-kube-api-access-6slnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.654643 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.654755 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654665 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.654755 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.654704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/233e5c17-9793-4e0b-beb7-e905382f17d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.755683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.755852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/233e5c17-9793-4e0b-beb7-e905382f17d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.755852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.755852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.756018 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6slnd\" (UniqueName: \"kubernetes.io/projected/233e5c17-9793-4e0b-beb7-e905382f17d4-kube-api-access-6slnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.756018 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.755961 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.756125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.756033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.756125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.756065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.756125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.756097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.758247 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.758225 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/233e5c17-9793-4e0b-beb7-e905382f17d4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.758517 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.758499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/233e5c17-9793-4e0b-beb7-e905382f17d4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.768972 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.768947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6slnd\" (UniqueName: \"kubernetes.io/projected/233e5c17-9793-4e0b-beb7-e905382f17d4-kube-api-access-6slnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt\" (UID: \"233e5c17-9793-4e0b-beb7-e905382f17d4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:02.868824 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:02.868743 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:03.006758 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:03.006730 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt"] Jul 07 19:19:03.008302 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:19:03.008271 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod233e5c17_9793_4e0b_beb7_e905382f17d4.slice/crio-6861e07a499fe7ac079cc9dc86da0c9829e7bd26bd261025b2ae1a7582734936 WatchSource:0}: Error finding container 6861e07a499fe7ac079cc9dc86da0c9829e7bd26bd261025b2ae1a7582734936: Status 404 returned error can't find the container with id 6861e07a499fe7ac079cc9dc86da0c9829e7bd26bd261025b2ae1a7582734936 Jul 07 19:19:03.520689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:03.520607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" event={"ID":"233e5c17-9793-4e0b-beb7-e905382f17d4","Type":"ContainerStarted","Data":"a59c997783d6167243648d8e670f53c17ccc3fc858e4b28861ef8eb9a41d39f8"} Jul 07 19:19:03.520689 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:03.520662 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" event={"ID":"233e5c17-9793-4e0b-beb7-e905382f17d4","Type":"ContainerStarted","Data":"6861e07a499fe7ac079cc9dc86da0c9829e7bd26bd261025b2ae1a7582734936"} Jul 07 19:19:03.548108 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:03.548061 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" podStartSLOduration=1.32713408 podStartE2EDuration="1.54804156s" totalImagesPullingTime="220.90748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:19:03.547033201 +0000 UTC m=+661.765021838" watchObservedRunningTime="2026-07-07 19:19:03.54804156 +0000 UTC m=+661.766030195" Jul 07 19:19:04.261169 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:04.261139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:19:09.088884 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:09.088839 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:19:09.089317 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:09.088906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:19:09.101697 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:09.101668 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:19:09.568666 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:09.568636 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nsxbz" Jul 07 19:19:11.978761 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:11.978724 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:19:12.869813 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:12.869765 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:12.870027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:12.869869 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:12.882664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:12.882637 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:13.588975 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:13.588915 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt" Jul 07 19:19:22.505678 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:19:22.505639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:20:57.070574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:20:57.070544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:21:08.160427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:21:08.160392 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:21:18.369064 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:21:18.369032 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:21:27.052363 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:21:27.052279 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:21:38.060655 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:21:38.060619 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:22:06.498995 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:22:06.498957 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:22:19.967437 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:22:19.967406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:22:56.369815 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:22:56.369737 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:02.178196 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:02.178164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:23:02.183972 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:02.183946 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:23:05.951467 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:05.951432 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:16.758799 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:16.758763 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:24.255101 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:24.255061 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:34.665782 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:34.665750 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:44.686985 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:44.686953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:23:57.380394 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:23:57.380356 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:24:07.448464 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:24:07.448430 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:24:28.875037 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:24:28.874951 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:24:39.166414 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:24:39.166377 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:25:05.560686 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:25:05.560650 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:25:18.170824 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:25:18.170786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:25:34.266398 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:25:34.266362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:25:43.463646 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:25:43.463614 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:25:52.457618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:25:52.457568 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:26:01.965631 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:26:01.965593 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:26:11.658447 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:26:11.658406 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:27:58.854479 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:27:58.854434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:28:02.213641 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:02.213612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:28:02.215851 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:02.215829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:28:10.948443 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:10.948407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:28:21.052347 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:21.052313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:28:31.563169 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:31.563134 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:28:43.154657 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:43.154625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:28:54.353707 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:28:54.353621 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:29:03.574867 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:29:03.574825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:29:14.748670 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:29:14.748639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:29:24.047162 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:29:24.047125 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:29:34.390513 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:29:34.390479 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:29:45.853343 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:29:45.853308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:30:00.192933 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.192898 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724210-wzftq"] Jul 07 19:30:00.196244 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.196222 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:00.200282 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.200264 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-tdpwr\"" Jul 07 19:30:00.271734 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.271704 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724210-wzftq"] Jul 07 19:30:00.327393 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.327365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwqh\" (UniqueName: \"kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh\") pod \"maas-api-key-cleanup-29724210-wzftq\" (UID: \"b5aafe59-efc5-4f01-b343-b10777d4f3a5\") " pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:00.428335 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.428300 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwqh\" (UniqueName: \"kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh\") pod \"maas-api-key-cleanup-29724210-wzftq\" (UID: \"b5aafe59-efc5-4f01-b343-b10777d4f3a5\") " pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:00.439318 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.439292 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwqh\" (UniqueName: \"kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh\") pod \"maas-api-key-cleanup-29724210-wzftq\" (UID: \"b5aafe59-efc5-4f01-b343-b10777d4f3a5\") " pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:00.506406 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.506311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:00.647927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.647892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724210-wzftq"] Jul 07 19:30:00.650789 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:30:00.650762 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5aafe59_efc5_4f01_b343_b10777d4f3a5.slice/crio-39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623 WatchSource:0}: Error finding container 39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623: Status 404 returned error can't find the container with id 39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623 Jul 07 19:30:00.652782 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.652765 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:30:00.940949 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:00.940914 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" event={"ID":"b5aafe59-efc5-4f01-b343-b10777d4f3a5","Type":"ContainerStarted","Data":"39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623"} Jul 07 19:30:03.960619 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:03.960582 2576 generic.go:356] "Generic (PLEG): container finished" podID="b5aafe59-efc5-4f01-b343-b10777d4f3a5" containerID="20fbb31bd2ed6aa65994bb9a1d11ba782dd77deef078082e5a26f3a09a9196de" exitCode=0 Jul 07 19:30:03.961010 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:03.960641 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" event={"ID":"b5aafe59-efc5-4f01-b343-b10777d4f3a5","Type":"ContainerDied","Data":"20fbb31bd2ed6aa65994bb9a1d11ba782dd77deef078082e5a26f3a09a9196de"} Jul 07 19:30:05.103796 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.103774 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:05.272221 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.272139 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpwqh\" (UniqueName: \"kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh\") pod \"b5aafe59-efc5-4f01-b343-b10777d4f3a5\" (UID: \"b5aafe59-efc5-4f01-b343-b10777d4f3a5\") " Jul 07 19:30:05.274471 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.274425 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh" (OuterVolumeSpecName: "kube-api-access-gpwqh") pod "b5aafe59-efc5-4f01-b343-b10777d4f3a5" (UID: "b5aafe59-efc5-4f01-b343-b10777d4f3a5"). InnerVolumeSpecName "kube-api-access-gpwqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:30:05.372766 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.372734 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpwqh\" (UniqueName: \"kubernetes.io/projected/b5aafe59-efc5-4f01-b343-b10777d4f3a5-kube-api-access-gpwqh\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:30:05.971822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.971795 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" Jul 07 19:30:05.971991 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.971825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724210-wzftq" event={"ID":"b5aafe59-efc5-4f01-b343-b10777d4f3a5","Type":"ContainerDied","Data":"39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623"} Jul 07 19:30:05.971991 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:05.971869 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39af90a90a447bbc3d1265ae3101d12079dc9b02e324a0daa58476f32f847623" Jul 07 19:30:11.458237 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:11.458202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:30:18.664381 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:18.664341 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:30:27.403005 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:27.402909 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:30:38.974523 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:38.974485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:30:56.160406 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:30:56.160371 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:31:10.475125 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:31:10.475093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:31:22.965181 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:31:22.965146 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:31:39.849988 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:31:39.849955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:31:47.662180 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:31:47.662146 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:32:03.763923 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:32:03.763850 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:32:15.332710 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:32:15.332674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:32:29.243877 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:32:29.243847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:32:40.473786 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:32:40.473751 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:32:49.466915 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:32:49.466878 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:00.752673 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:00.752636 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:02.257009 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:02.256978 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:33:02.257959 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:02.257941 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:33:12.854216 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:12.854183 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:24.644244 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:24.644168 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:34.857267 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:34.857223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:44.556184 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:44.556147 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:33:57.038964 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:33:57.038931 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:34:07.560443 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:34:07.560407 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:34:20.543775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:34:20.543734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:34:32.432780 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:34:32.432747 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:36:08.952889 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:36:08.952847 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:36:16.637836 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:36:16.637800 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:36:25.347391 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:36:25.347307 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:36:36.858390 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:36:36.858355 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:36:48.742948 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:36:48.742916 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:37:15.442258 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:37:15.442223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:37:26.341152 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:37:26.341115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:37:55.440917 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:37:55.440811 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:38:02.294142 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:38:02.294112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:38:02.295522 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:38:02.295499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:38:05.942080 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:38:05.942043 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:38:15.842227 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:38:15.842191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:38:51.641656 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:38:51.641617 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:39:00.761708 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:00.761678 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:39:13.971531 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:13.971499 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:39:58.330468 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.330427 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:39:58.330950 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.330832 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5aafe59-efc5-4f01-b343-b10777d4f3a5" containerName="cleanup" Jul 07 19:39:58.330950 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.330845 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5aafe59-efc5-4f01-b343-b10777d4f3a5" containerName="cleanup" Jul 07 19:39:58.330950 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.330908 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5aafe59-efc5-4f01-b343-b10777d4f3a5" containerName="cleanup" Jul 07 19:39:58.334077 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.334057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.337929 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.337901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-548bc4-openshift-default-dockercfg-fh5bv\"" Jul 07 19:39:58.351961 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.351935 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:39:58.411437 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411400 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411635 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411635 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411635 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411635 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7dph\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.411822 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.411722 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512414 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512414 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512418 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7dph\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.512705 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.513067 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.512982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.513116 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.513082 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.513170 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.513155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.513228 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.513202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.513481 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.513440 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.515129 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.515109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.515252 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.515236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.521632 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.521610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.521772 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.521754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7dph\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph\") pod \"e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.643870 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.643843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:58.798312 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.792507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:39:58.801573 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.801533 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:39:58.801683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.801614 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:39:58.801683 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:58.801652 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:39:59.088578 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:59.088490 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerStarted","Data":"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa"} Jul 07 19:39:59.088578 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:59.088545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerStarted","Data":"54b2475eba93c7c3d2ca66af52c4a82372062b0207f05c5cda356a2fcdb66eae"} Jul 07 19:39:59.113350 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:59.113304 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podStartSLOduration=1.11329031 podStartE2EDuration="1.11329031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:39:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:39:59.111350913 +0000 UTC m=+1917.329339550" watchObservedRunningTime="2026-07-07 19:39:59.11329031 +0000 UTC m=+1917.331278949" Jul 07 19:39:59.644852 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:59.644824 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:39:59.649639 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:39:59.649613 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:00.094009 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:00.093919 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:00.095008 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:00.094988 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:01.081615 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:01.081583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:40:19.199105 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.199073 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerID="6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa" exitCode=0 Jul 07 19:40:19.199528 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.199150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerDied","Data":"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa"} Jul 07 19:40:19.199528 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.199522 2576 scope.go:117] "RemoveContainer" containerID="6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa" Jul 07 19:40:19.200439 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.200411 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:40:19.200561 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.200494 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:40:19.200561 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:19.200528 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:40:20.152797 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:20.152760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:40:20.206988 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:20.206949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerStarted","Data":"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9"} Jul 07 19:40:20.644065 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:20.644034 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:20.644339 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:20.644321 2576 patch_prober.go:28] interesting pod/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 19:40:20.644403 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:20.644360 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 19:40:21.644745 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:21.644712 2576 patch_prober.go:28] interesting pod/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 19:40:21.645106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:21.644766 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 19:40:22.644371 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:22.644337 2576 patch_prober.go:28] interesting pod/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 19:40:22.644574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:22.644390 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 19:40:23.644169 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:23.644132 2576 patch_prober.go:28] interesting pod/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body= Jul 07 19:40:23.644636 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:23.644187 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" Jul 07 19:40:24.647579 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:24.647549 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:24.647969 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:24.647955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:24.648712 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:24.648691 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:40:44.258157 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:44.258123 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:40:58.565097 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:40:58.565004 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:41:19.586517 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:41:19.586483 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:42:05.391113 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:05.391078 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:42:10.311859 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:10.311826 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:42:10.312267 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:10.312049 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" containerID="cri-o://3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9" gracePeriod=30 Jul 07 19:42:15.574763 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.574706 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:42:15.669781 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669748 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.669953 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669804 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.669953 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669834 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.669953 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669908 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.669953 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669946 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.669969 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7dph\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670004 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670004 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670028 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket\") pod \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\" (UID: \"9e52cd2a-4110-4f4d-aa50-d953ada849b5\") " Jul 07 19:42:15.670167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670131 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:15.670497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670400 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-certs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.670497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670421 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-workload-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.670497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670423 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:42:15.670828 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670566 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:15.670901 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.670876 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:15.672246 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.672218 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph" (OuterVolumeSpecName: "kube-api-access-s7dph") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "kube-api-access-s7dph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:42:15.672431 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.672411 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:42:15.672693 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.672675 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 19:42:15.672819 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.672797 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e52cd2a-4110-4f4d-aa50-d953ada849b5" (UID: "9e52cd2a-4110-4f4d-aa50-d953ada849b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:15.770970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.770937 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-data\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.770970 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.770965 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.771145 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.770980 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7dph\" (UniqueName: \"kubernetes.io/projected/9e52cd2a-4110-4f4d-aa50-d953ada849b5-kube-api-access-s7dph\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.771145 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.770995 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istiod-ca-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.771145 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.771006 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-envoy\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.771145 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.771017 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e52cd2a-4110-4f4d-aa50-d953ada849b5-credential-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.771145 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.771028 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e52cd2a-4110-4f4d-aa50-d953ada849b5-istio-podinfo\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:15.816412 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.816384 2576 generic.go:356] "Generic (PLEG): container finished" podID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerID="3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9" exitCode=0 Jul 07 19:42:15.816551 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.816434 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" Jul 07 19:42:15.816551 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.816483 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerDied","Data":"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9"} Jul 07 19:42:15.816551 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.816541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj" event={"ID":"9e52cd2a-4110-4f4d-aa50-d953ada849b5","Type":"ContainerDied","Data":"54b2475eba93c7c3d2ca66af52c4a82372062b0207f05c5cda356a2fcdb66eae"} Jul 07 19:42:15.816660 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.816573 2576 scope.go:117] "RemoveContainer" containerID="3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9" Jul 07 19:42:15.826492 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.826474 2576 scope.go:117] "RemoveContainer" containerID="6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa" Jul 07 19:42:15.834775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.834760 2576 scope.go:117] "RemoveContainer" containerID="3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9" Jul 07 19:42:15.835006 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:42:15.834988 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9\": container with ID starting with 3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9 not found: ID does not exist" containerID="3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9" Jul 07 19:42:15.835052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.835014 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9"} err="failed to get container status \"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9\": rpc error: code = NotFound desc = could not find container \"3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9\": container with ID starting with 3cf25cd9b75ddcdfc564fbb43c58634895efb9cb2d5b7ff719c97e5ddec1f9a9 not found: ID does not exist" Jul 07 19:42:15.835052 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.835030 2576 scope.go:117] "RemoveContainer" containerID="6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa" Jul 07 19:42:15.835261 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:42:15.835243 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa\": container with ID starting with 6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa not found: ID does not exist" containerID="6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa" Jul 07 19:42:15.835310 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.835264 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa"} err="failed to get container status \"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa\": rpc error: code = NotFound desc = could not find container \"6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa\": container with ID starting with 6b68e4dd62905e0a49affc08616c4b59489554297f37459c1b1639b4a5d324fa not found: ID does not exist" Jul 07 19:42:15.859117 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.859100 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:42:15.866884 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:15.866862 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-548bc4-openshift-default-58cd8f9bdc-jxhbj"] Jul 07 19:42:16.231011 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:16.230976 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" path="/var/lib/kubelet/pods/9e52cd2a-4110-4f4d-aa50-d953ada849b5/volumes" Jul 07 19:42:19.860109 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:19.860075 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:42:20.832722 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.832691 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:42:20.833149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.833130 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:42:20.833149 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.833150 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:42:20.833323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.833183 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:42:20.833323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.833191 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:42:20.833323 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.833292 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:42:20.837985 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.837965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.841174 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.841156 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-bdaaac-openshift-default-dockercfg-7lm6b\"" Jul 07 19:42:20.856493 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.856470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:42:20.912443 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldzq\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:20.912854 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:20.912739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.013964 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.013934 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014151 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.013973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014151 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.013995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014151 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014337 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014337 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldzq\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014337 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014337 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014248 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.014337 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.015061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014377 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.015061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.015061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.015061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.015061 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.014875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.016434 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.016412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.016583 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.016567 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.031913 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.031886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.034319 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.034295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldzq\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq\") pod \"e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.149348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.149323 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:21.314238 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.314213 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:42:21.316119 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:42:21.316096 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280ed2a5_dbcb_45b6_9091_52d5c8c44b22.slice/crio-3c6fa467e32987a4c2be6f60172a87bec87fba50f225bc2bf89b316e99e3b0e4 WatchSource:0}: Error finding container 3c6fa467e32987a4c2be6f60172a87bec87fba50f225bc2bf89b316e99e3b0e4: Status 404 returned error can't find the container with id 3c6fa467e32987a4c2be6f60172a87bec87fba50f225bc2bf89b316e99e3b0e4 Jul 07 19:42:21.318150 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.318109 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:21.318230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.318181 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:21.318230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.318208 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:21.853597 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.853560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerStarted","Data":"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741"} Jul 07 19:42:21.853765 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.853615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerStarted","Data":"3c6fa467e32987a4c2be6f60172a87bec87fba50f225bc2bf89b316e99e3b0e4"} Jul 07 19:42:21.884420 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:21.884378 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podStartSLOduration=1.884362951 podStartE2EDuration="1.884362951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:42:21.879930836 +0000 UTC m=+2060.097919472" watchObservedRunningTime="2026-07-07 19:42:21.884362951 +0000 UTC m=+2060.102351587" Jul 07 19:42:22.150270 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:22.150242 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:22.155439 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:22.155416 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:22.859167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:22.859089 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:22.859833 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:22.859816 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:36.938127 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.938087 2576 generic.go:356] "Generic (PLEG): container finished" podID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerID="2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741" exitCode=0 Jul 07 19:42:36.938598 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.938160 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerDied","Data":"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741"} Jul 07 19:42:36.938598 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.938572 2576 scope.go:117] "RemoveContainer" containerID="2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741" Jul 07 19:42:36.939598 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.939569 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:36.939676 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.939660 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:36.939727 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:36.939712 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:42:37.274104 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:37.274014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:42:37.859542 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:37.859509 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:37.945688 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:37.945656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerStarted","Data":"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09"} Jul 07 19:42:38.150414 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:38.150370 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:38.151617 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:38.151594 2576 patch_prober.go:28] interesting pod/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 19:42:38.151680 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:38.151653 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 19:42:39.150434 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:39.150399 2576 patch_prober.go:28] interesting pod/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 19:42:39.150840 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:39.150482 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 19:42:40.150432 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:40.150400 2576 patch_prober.go:28] interesting pod/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 19:42:40.150619 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:40.150479 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 19:42:41.149952 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:41.149918 2576 patch_prober.go:28] interesting pod/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body= Jul 07 19:42:41.150141 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:41.149976 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" Jul 07 19:42:42.153604 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:42.153566 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:42.154116 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:42.153845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:42.154696 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:42.154680 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:48.942437 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:48.942396 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:42:53.394927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:53.394887 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:42:53.395354 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:53.395138 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" containerID="cri-o://d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09" gracePeriod=30 Jul 07 19:42:57.156490 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:57.156437 2576 patch_prober.go:28] interesting pod/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 19:42:57.156858 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:57.156528 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 19:42:58.658599 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.658529 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:58.746305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746261 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746320 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746350 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746380 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746413 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ldzq\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746434 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746527 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746528 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746550 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data\") pod \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\" (UID: \"280ed2a5-dbcb-45b6-9091-52d5c8c44b22\") " Jul 07 19:42:58.746895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746603 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:58.746895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746722 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:58.746895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746808 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:42:58.746895 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746873 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-certs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.747153 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.746913 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-credential-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.747153 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.747100 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:58.747607 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.747584 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data" (OuterVolumeSpecName: "istio-data") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:58.748878 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.748853 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token" (OuterVolumeSpecName: "istio-token") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:42:58.748966 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.748897 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 19:42:58.749178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.749158 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:42:58.749178 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.749156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq" (OuterVolumeSpecName: "kube-api-access-2ldzq") pod "280ed2a5-dbcb-45b6-9091-52d5c8c44b22" (UID: "280ed2a5-dbcb-45b6-9091-52d5c8c44b22"). InnerVolumeSpecName "kube-api-access-2ldzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:42:58.847509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847439 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-envoy\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847504 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istiod-ca-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847514 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ldzq\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-kube-api-access-2ldzq\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847523 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847779 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847531 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-podinfo\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847779 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847539 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-workload-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:58.847779 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:58.847547 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/280ed2a5-dbcb-45b6-9091-52d5c8c44b22-istio-data\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:42:59.069075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.068993 2576 generic.go:356] "Generic (PLEG): container finished" podID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerID="d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09" exitCode=0 Jul 07 19:42:59.069075 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.069038 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" Jul 07 19:42:59.069267 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.069071 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerDied","Data":"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09"} Jul 07 19:42:59.069267 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.069149 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq" event={"ID":"280ed2a5-dbcb-45b6-9091-52d5c8c44b22","Type":"ContainerDied","Data":"3c6fa467e32987a4c2be6f60172a87bec87fba50f225bc2bf89b316e99e3b0e4"} Jul 07 19:42:59.069267 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.069171 2576 scope.go:117] "RemoveContainer" containerID="d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09" Jul 07 19:42:59.078819 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.078802 2576 scope.go:117] "RemoveContainer" containerID="2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741" Jul 07 19:42:59.086927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.086906 2576 scope.go:117] "RemoveContainer" containerID="d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09" Jul 07 19:42:59.087182 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:42:59.087163 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09\": container with ID starting with d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09 not found: ID does not exist" containerID="d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09" Jul 07 19:42:59.087223 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.087191 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09"} err="failed to get container status \"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09\": rpc error: code = NotFound desc = could not find container \"d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09\": container with ID starting with d10724c3f8bad0c88ea8fd8bf4e533c030739196730c0b6050fae149bae80b09 not found: ID does not exist" Jul 07 19:42:59.087223 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.087208 2576 scope.go:117] "RemoveContainer" containerID="2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741" Jul 07 19:42:59.087436 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:42:59.087416 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741\": container with ID starting with 2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741 not found: ID does not exist" containerID="2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741" Jul 07 19:42:59.087504 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.087443 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741"} err="failed to get container status \"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741\": rpc error: code = NotFound desc = could not find container \"2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741\": container with ID starting with 2d4855ea2cf4ab58ec7766100c6bea20b19a90c41e2636e370bf5c8492ed1741 not found: ID does not exist" Jul 07 19:42:59.098740 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.098717 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:42:59.123280 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:42:59.123247 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-bdaaac-openshift-default-54887c99b9-c58rq"] Jul 07 19:43:00.230814 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:00.230781 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" path="/var/lib/kubelet/pods/280ed2a5-dbcb-45b6-9091-52d5c8c44b22/volumes" Jul 07 19:43:02.335681 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.335653 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:43:02.339875 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.339842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:43:02.790304 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790266 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:43:02.790668 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790654 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:43:02.790717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790669 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:43:02.790756 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790729 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:43:02.790756 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790736 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:43:02.790756 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.790743 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e52cd2a-4110-4f4d-aa50-d953ada849b5" containerName="istio-proxy" Jul 07 19:43:02.795222 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.795206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.799843 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.799814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-fe4a68-openshift-default-dockercfg-fplnd\"" Jul 07 19:43:02.819500 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.819478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:43:02.882866 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.882831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.882866 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.882866 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.882888 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.882932 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t2ht\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.882982 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.883003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.883025 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.883115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.883365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.883142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984088 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984088 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984179 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t2ht\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984207 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984225 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984328 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984743 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984743 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984743 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984892 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.984892 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.984871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.987035 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.987010 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:02.987163 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:02.987144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:03.009192 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.009162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t2ht\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:03.011239 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.011222 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token\") pod \"e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:03.082717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.082607 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:43:03.105581 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.105537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:03.275858 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.275833 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:43:03.277864 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:43:03.277839 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97edb523_5f06_45be_b8ad_7ed711d149cf.slice/crio-adfc74308abb6406897b8421e8cfb10f3e62410b4768d0a90d2f001f075c3167 WatchSource:0}: Error finding container adfc74308abb6406897b8421e8cfb10f3e62410b4768d0a90d2f001f075c3167: Status 404 returned error can't find the container with id adfc74308abb6406897b8421e8cfb10f3e62410b4768d0a90d2f001f075c3167 Jul 07 19:43:03.279996 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.279966 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:03.280058 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.280028 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:03.280098 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:03.280055 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:04.100263 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:04.100219 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerStarted","Data":"3b56c3030e7290ff66da1c668b7a286035ac675b8f7402721d4734a6d3930f25"} Jul 07 19:43:04.100710 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:04.100281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerStarted","Data":"adfc74308abb6406897b8421e8cfb10f3e62410b4768d0a90d2f001f075c3167"} Jul 07 19:43:04.106306 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:04.106287 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:04.110997 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:04.110978 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:04.129218 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:04.129168 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podStartSLOduration=2.129153645 podStartE2EDuration="2.129153645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:43:04.126758463 +0000 UTC m=+2102.344747110" watchObservedRunningTime="2026-07-07 19:43:04.129153645 +0000 UTC m=+2102.347142280" Jul 07 19:43:05.105820 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:05.105787 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:05.106641 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:05.106622 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:18.180380 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.180343 2576 generic.go:356] "Generic (PLEG): container finished" podID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerID="3b56c3030e7290ff66da1c668b7a286035ac675b8f7402721d4734a6d3930f25" exitCode=0 Jul 07 19:43:18.180927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.180418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerDied","Data":"3b56c3030e7290ff66da1c668b7a286035ac675b8f7402721d4734a6d3930f25"} Jul 07 19:43:18.180927 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.180915 2576 scope.go:117] "RemoveContainer" containerID="3b56c3030e7290ff66da1c668b7a286035ac675b8f7402721d4734a6d3930f25" Jul 07 19:43:18.181996 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.181960 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:18.182093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.182029 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:18.182093 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.182062 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 07 19:43:18.947138 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:18.947101 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:43:19.192297 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:19.192253 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerStarted","Data":"122de2355895622ddf128f6fc871317204239052d4637d3cafa9537372d2d0e5"} Jul 07 19:43:20.105890 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:20.105847 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:20.106086 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:20.105912 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:20.107104 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:20.107076 2576 patch_prober.go:28] interesting pod/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 19:43:20.107177 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:20.107132 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 19:43:21.106591 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:21.106557 2576 patch_prober.go:28] interesting pod/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 19:43:21.106993 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:21.106609 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 19:43:22.105964 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:22.105924 2576 patch_prober.go:28] interesting pod/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 19:43:22.106142 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:22.105991 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 19:43:23.106368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:23.106334 2576 patch_prober.go:28] interesting pod/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body= Jul 07 19:43:23.106778 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:23.106390 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" Jul 07 19:43:24.110106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:24.110077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:24.111156 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:24.111134 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:43:30.555044 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:43:30.555014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:44:03.764447 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:44:03.764366 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:44:26.162614 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:44:26.162581 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:44:45.141936 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:44:45.141902 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:45:03.059399 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:45:03.059361 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:45:20.174342 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:45:20.174307 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:45:37.573265 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:45:37.573225 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:45:55.755749 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:45:55.755707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:46:12.358071 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:12.358037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:46:19.758956 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.758921 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:46:19.759376 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.759351 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:46:19.759376 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.759368 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="280ed2a5-dbcb-45b6-9091-52d5c8c44b22" containerName="istio-proxy" Jul 07 19:46:19.762475 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.762436 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.769862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.769834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-778336\"/\"sub-test-model-778336-kserve-self-signed-certs\"" Jul 07 19:46:19.769988 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.769875 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-778336\"/\"kube-root-ca.crt\"" Jul 07 19:46:19.769988 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.769890 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-778336\"/\"default-dockercfg-cdqvr\"" Jul 07 19:46:19.769988 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.769877 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-778336\"/\"openshift-service-ca.crt\"" Jul 07 19:46:19.777700 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.777674 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:46:19.869166 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869132 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.869360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.869360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.869360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869228 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.869360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml68p\" (UniqueName: \"kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.869360 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.869326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.969891 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.969851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.969911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.969942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.969965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.969998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml68p\" (UniqueName: \"kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.970044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970374 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.970351 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970497 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.970438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.970574 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.970521 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.972366 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.972345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.972774 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.972756 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:19.980188 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:19.980160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml68p\" (UniqueName: \"kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p\") pod \"sub-test-model-778336-kserve-68fd7d9cc9-mtql5\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:20.072019 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:20.071929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:20.217348 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:20.217316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:46:20.218839 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:46:20.218809 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd68ba3a0_fab3_4fba_9962_f84a5ccef591.slice/crio-f90a09b88042c7200df75eeda747b9f0b418d24ba32cd1958c30dcdeb00a9bbc WatchSource:0}: Error finding container f90a09b88042c7200df75eeda747b9f0b418d24ba32cd1958c30dcdeb00a9bbc: Status 404 returned error can't find the container with id f90a09b88042c7200df75eeda747b9f0b418d24ba32cd1958c30dcdeb00a9bbc Jul 07 19:46:21.156259 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:21.156222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" event={"ID":"d68ba3a0-fab3-4fba-9962-f84a5ccef591","Type":"ContainerStarted","Data":"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939"} Jul 07 19:46:21.156654 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:21.156269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" event={"ID":"d68ba3a0-fab3-4fba-9962-f84a5ccef591","Type":"ContainerStarted","Data":"f90a09b88042c7200df75eeda747b9f0b418d24ba32cd1958c30dcdeb00a9bbc"} Jul 07 19:46:21.199229 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:21.199182 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" podStartSLOduration=2.199166323 podStartE2EDuration="2.199166323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:46:21.19680534 +0000 UTC m=+2299.414793977" watchObservedRunningTime="2026-07-07 19:46:21.199166323 +0000 UTC m=+2299.417154959" Jul 07 19:46:24.445542 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:24.445506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:46:30.072397 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:30.072363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:30.072898 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:30.072413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:30.084819 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:30.084797 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:46:30.215084 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:46:30.215058 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:47:06.353136 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:47:06.353054 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:47:29.654496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:47:29.654443 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:47:49.588435 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:47:49.588393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:47:54.643157 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:47:54.643120 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:48:02.152578 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:02.152549 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:48:02.371446 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:02.371415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:48:02.377332 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:02.377312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:48:09.664634 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.664575 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" podUID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" containerName="main" containerID="cri-o://1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939" gracePeriod=45 Jul 07 19:48:09.917156 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.917097 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:48:09.964044 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964019 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964186 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964058 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964186 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964109 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml68p\" (UniqueName: \"kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964186 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964140 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964233 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964365 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964314 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache" (OuterVolumeSpecName: "model-cache") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:48:09.964480 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964364 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm\") pod \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\" (UID: \"d68ba3a0-fab3-4fba-9962-f84a5ccef591\") " Jul 07 19:48:09.964480 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964372 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:48:09.964605 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964492 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home" (OuterVolumeSpecName: "home") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:48:09.964830 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964777 2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-home\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:09.964830 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964796 2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-model-cache\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:09.964830 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.964810 2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tmp-dir\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:09.966541 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.966518 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm" (OuterVolumeSpecName: "dshm") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:48:09.966629 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.966612 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p" (OuterVolumeSpecName: "kube-api-access-ml68p") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "kube-api-access-ml68p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:48:09.966795 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:09.966779 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d68ba3a0-fab3-4fba-9962-f84a5ccef591" (UID: "d68ba3a0-fab3-4fba-9962-f84a5ccef591"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 19:48:10.066114 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.066079 2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d68ba3a0-fab3-4fba-9962-f84a5ccef591-dshm\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:10.066114 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.066108 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml68p\" (UniqueName: \"kubernetes.io/projected/d68ba3a0-fab3-4fba-9962-f84a5ccef591-kube-api-access-ml68p\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:10.066114 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.066119 2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d68ba3a0-fab3-4fba-9962-f84a5ccef591-tls-certs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:48:10.742400 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.742366 2576 generic.go:356] "Generic (PLEG): container finished" podID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" containerID="1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939" exitCode=0 Jul 07 19:48:10.742838 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.742413 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" Jul 07 19:48:10.742838 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.742469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" event={"ID":"d68ba3a0-fab3-4fba-9962-f84a5ccef591","Type":"ContainerDied","Data":"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939"} Jul 07 19:48:10.742838 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.742515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5" event={"ID":"d68ba3a0-fab3-4fba-9962-f84a5ccef591","Type":"ContainerDied","Data":"f90a09b88042c7200df75eeda747b9f0b418d24ba32cd1958c30dcdeb00a9bbc"} Jul 07 19:48:10.742838 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.742533 2576 scope.go:117] "RemoveContainer" containerID="1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939" Jul 07 19:48:10.751670 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.751650 2576 scope.go:117] "RemoveContainer" containerID="1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939" Jul 07 19:48:10.751910 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:48:10.751892 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939\": container with ID starting with 1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939 not found: ID does not exist" containerID="1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939" Jul 07 19:48:10.751962 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.751920 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939"} err="failed to get container status \"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939\": rpc error: code = NotFound desc = could not find container \"1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939\": container with ID starting with 1c4f42de0fc5b98f582702ec8ff198798516458fa8c1360c453a7f2cc4c9a939 not found: ID does not exist" Jul 07 19:48:10.764239 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.764217 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:48:10.768979 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:10.768959 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-778336/sub-test-model-778336-kserve-68fd7d9cc9-mtql5"] Jul 07 19:48:12.230625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:12.230596 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" path="/var/lib/kubelet/pods/d68ba3a0-fab3-4fba-9962-f84a5ccef591/volumes" Jul 07 19:48:17.480496 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:17.480466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:48:31.153785 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:31.153701 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:48:51.974278 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:48:51.974234 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:49:08.156926 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:08.156889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:49:16.077167 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.077131 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7392-140448518122944"] Jul 07 19:49:16.077589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.077537 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" containerName="main" Jul 07 19:49:16.077589 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.077549 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" containerName="main" Jul 07 19:49:16.077662 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.077621 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68ba3a0-fab3-4fba-9962-f84a5ccef591" containerName="main" Jul 07 19:49:16.080762 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.080741 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:16.083949 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.083931 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v6rqr\"" Jul 07 19:49:16.091787 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.091760 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448518122944"] Jul 07 19:49:16.224520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.224448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hxbx\" (UniqueName: \"kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx\") pod \"test-curl-7392-140448518122944\" (UID: \"6ff61ee2-467d-440a-be2c-b8d97ce6f19d\") " pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:16.325634 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.325595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hxbx\" (UniqueName: \"kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx\") pod \"test-curl-7392-140448518122944\" (UID: \"6ff61ee2-467d-440a-be2c-b8d97ce6f19d\") " pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:16.336490 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.336423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hxbx\" (UniqueName: \"kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx\") pod \"test-curl-7392-140448518122944\" (UID: \"6ff61ee2-467d-440a-be2c-b8d97ce6f19d\") " pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:16.390509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.390449 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:16.528651 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.528625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448518122944"] Jul 07 19:49:16.530935 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:49:16.530905 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ff61ee2_467d_440a_be2c_b8d97ce6f19d.slice/crio-3a54dfc7fee8c6fe80cc756b2bb1703b7d475427801e749ea2eb3bb4b792ab94 WatchSource:0}: Error finding container 3a54dfc7fee8c6fe80cc756b2bb1703b7d475427801e749ea2eb3bb4b792ab94: Status 404 returned error can't find the container with id 3a54dfc7fee8c6fe80cc756b2bb1703b7d475427801e749ea2eb3bb4b792ab94 Jul 07 19:49:16.532533 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:16.532515 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 19:49:17.099632 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:17.099596 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448518122944" event={"ID":"6ff61ee2-467d-440a-be2c-b8d97ce6f19d","Type":"ContainerStarted","Data":"3a54dfc7fee8c6fe80cc756b2bb1703b7d475427801e749ea2eb3bb4b792ab94"} Jul 07 19:49:18.114054 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:18.114018 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" containerID="b2df680e68708f4968475bb1c91c78318cf66194482ee3c74718a992eb3b69bb" exitCode=0 Jul 07 19:49:18.114441 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:18.114064 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448518122944" event={"ID":"6ff61ee2-467d-440a-be2c-b8d97ce6f19d","Type":"ContainerDied","Data":"b2df680e68708f4968475bb1c91c78318cf66194482ee3c74718a992eb3b69bb"} Jul 07 19:49:19.252440 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.252416 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:19.328230 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.328191 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7392-140448518122944_6ff61ee2-467d-440a-be2c-b8d97ce6f19d/test-curl-7392-140448518122944/0.log" Jul 07 19:49:19.353346 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.353318 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hxbx\" (UniqueName: \"kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx\") pod \"6ff61ee2-467d-440a-be2c-b8d97ce6f19d\" (UID: \"6ff61ee2-467d-440a-be2c-b8d97ce6f19d\") " Jul 07 19:49:19.355536 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.355507 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx" (OuterVolumeSpecName: "kube-api-access-8hxbx") pod "6ff61ee2-467d-440a-be2c-b8d97ce6f19d" (UID: "6ff61ee2-467d-440a-be2c-b8d97ce6f19d"). InnerVolumeSpecName "kube-api-access-8hxbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:49:19.360223 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.360202 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7392-140448518122944"] Jul 07 19:49:19.368603 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.368581 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7392-140448518122944"] Jul 07 19:49:19.454921 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.454894 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hxbx\" (UniqueName: \"kubernetes.io/projected/6ff61ee2-467d-440a-be2c-b8d97ce6f19d-kube-api-access-8hxbx\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:19.489066 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.489039 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7392-140448518123056"] Jul 07 19:49:19.489413 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.489399 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" containerName="test-curl-7392-140448518122944" Jul 07 19:49:19.489494 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.489414 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" containerName="test-curl-7392-140448518122944" Jul 07 19:49:19.489532 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.489501 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" containerName="test-curl-7392-140448518122944" Jul 07 19:49:19.492520 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.492506 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:19.503112 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.503087 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448518123056"] Jul 07 19:49:19.657049 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.657010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxhc\" (UniqueName: \"kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc\") pod \"test-curl-7392-140448518123056\" (UID: \"288c73ac-7f77-4493-a7fc-d4f353157594\") " pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:19.757861 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.757775 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxhc\" (UniqueName: \"kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc\") pod \"test-curl-7392-140448518123056\" (UID: \"288c73ac-7f77-4493-a7fc-d4f353157594\") " pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:19.767457 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.767432 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxhc\" (UniqueName: \"kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc\") pod \"test-curl-7392-140448518123056\" (UID: \"288c73ac-7f77-4493-a7fc-d4f353157594\") " pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:19.802438 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.802416 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:19.938678 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:19.938654 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448518123056"] Jul 07 19:49:19.940207 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:49:19.940181 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod288c73ac_7f77_4493_a7fc_d4f353157594.slice/crio-018d732e57ccaab1a77d84f2af2c7fcd4b71ece98d008e024255038c2193967c WatchSource:0}: Error finding container 018d732e57ccaab1a77d84f2af2c7fcd4b71ece98d008e024255038c2193967c: Status 404 returned error can't find the container with id 018d732e57ccaab1a77d84f2af2c7fcd4b71ece98d008e024255038c2193967c Jul 07 19:49:20.126425 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:20.126346 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a54dfc7fee8c6fe80cc756b2bb1703b7d475427801e749ea2eb3bb4b792ab94" Jul 07 19:49:20.126425 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:20.126347 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:20.127616 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:20.127589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448518123056" event={"ID":"288c73ac-7f77-4493-a7fc-d4f353157594","Type":"ContainerStarted","Data":"018d732e57ccaab1a77d84f2af2c7fcd4b71ece98d008e024255038c2193967c"} Jul 07 19:49:20.138300 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:49:20.138275 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7392-140448518122944\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" pod="opendatahub/test-curl-7392-140448518122944" Jul 07 19:49:20.229903 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:20.229874 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff61ee2-467d-440a-be2c-b8d97ce6f19d" path="/var/lib/kubelet/pods/6ff61ee2-467d-440a-be2c-b8d97ce6f19d/volumes" Jul 07 19:49:21.134466 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:21.134412 2576 generic.go:356] "Generic (PLEG): container finished" podID="288c73ac-7f77-4493-a7fc-d4f353157594" containerID="ed09dc2fa509de036014e4f82b7494e3178203c86e93ba91ead6a31af482cb73" exitCode=0 Jul 07 19:49:21.134861 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:21.134489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448518123056" event={"ID":"288c73ac-7f77-4493-a7fc-d4f353157594","Type":"ContainerDied","Data":"ed09dc2fa509de036014e4f82b7494e3178203c86e93ba91ead6a31af482cb73"} Jul 07 19:49:22.068465 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.068427 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:49:22.273489 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.273444 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:22.298643 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.298608 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7392-140448518123056_288c73ac-7f77-4493-a7fc-d4f353157594/test-curl-7392-140448518123056/0.log" Jul 07 19:49:22.324699 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.324574 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7392-140448518123056"] Jul 07 19:49:22.327048 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.327025 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7392-140448518123056"] Jul 07 19:49:22.380636 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.380607 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gxhc\" (UniqueName: \"kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc\") pod \"288c73ac-7f77-4493-a7fc-d4f353157594\" (UID: \"288c73ac-7f77-4493-a7fc-d4f353157594\") " Jul 07 19:49:22.382799 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.382771 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc" (OuterVolumeSpecName: "kube-api-access-6gxhc") pod "288c73ac-7f77-4493-a7fc-d4f353157594" (UID: "288c73ac-7f77-4493-a7fc-d4f353157594"). InnerVolumeSpecName "kube-api-access-6gxhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:49:22.482137 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:22.482102 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gxhc\" (UniqueName: \"kubernetes.io/projected/288c73ac-7f77-4493-a7fc-d4f353157594-kube-api-access-6gxhc\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:23.146484 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:23.146430 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:23.146666 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:23.146489 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="018d732e57ccaab1a77d84f2af2c7fcd4b71ece98d008e024255038c2193967c" Jul 07 19:49:23.159268 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:49:23.159236 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7392-140448518123056\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="288c73ac-7f77-4493-a7fc-d4f353157594" pod="opendatahub/test-curl-7392-140448518123056" Jul 07 19:49:24.229746 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:24.229714 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="288c73ac-7f77-4493-a7fc-d4f353157594" path="/var/lib/kubelet/pods/288c73ac-7f77-4493-a7fc-d4f353157594/volumes" Jul 07 19:49:26.054026 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.053989 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7392-140448517755792"] Jul 07 19:49:26.054403 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.054346 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="288c73ac-7f77-4493-a7fc-d4f353157594" containerName="test-curl-7392-140448518123056" Jul 07 19:49:26.054403 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.054357 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="288c73ac-7f77-4493-a7fc-d4f353157594" containerName="test-curl-7392-140448518123056" Jul 07 19:49:26.054499 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.054413 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="288c73ac-7f77-4493-a7fc-d4f353157594" containerName="test-curl-7392-140448518123056" Jul 07 19:49:26.057508 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.057493 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:26.060874 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.060857 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v6rqr\"" Jul 07 19:49:26.065106 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.065086 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448517755792"] Jul 07 19:49:26.216808 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.216779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvw8h\" (UniqueName: \"kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h\") pod \"test-curl-7392-140448517755792\" (UID: \"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39\") " pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:26.317717 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.317628 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvw8h\" (UniqueName: \"kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h\") pod \"test-curl-7392-140448517755792\" (UID: \"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39\") " pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:26.330305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.330273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvw8h\" (UniqueName: \"kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h\") pod \"test-curl-7392-140448517755792\" (UID: \"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39\") " pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:26.368193 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.368160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:26.518299 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:26.518266 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7392-140448517755792"] Jul 07 19:49:26.521837 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:49:26.521808 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffaf81ab_e635_441c_b1f0_f62dcfdc6e39.slice/crio-6c06d75e83bed03df5541f67a3b1d653522c35481653928f9268014f67c759b7 WatchSource:0}: Error finding container 6c06d75e83bed03df5541f67a3b1d653522c35481653928f9268014f67c759b7: Status 404 returned error can't find the container with id 6c06d75e83bed03df5541f67a3b1d653522c35481653928f9268014f67c759b7 Jul 07 19:49:27.170055 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:27.170020 2576 generic.go:356] "Generic (PLEG): container finished" podID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" containerID="9d263df331bcbeb962da976302d762f3d6e40a29047f84ba5a440ab6f1b6a026" exitCode=0 Jul 07 19:49:27.170427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:27.170103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448517755792" event={"ID":"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39","Type":"ContainerDied","Data":"9d263df331bcbeb962da976302d762f3d6e40a29047f84ba5a440ab6f1b6a026"} Jul 07 19:49:27.170427 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:27.170139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7392-140448517755792" event={"ID":"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39","Type":"ContainerStarted","Data":"6c06d75e83bed03df5541f67a3b1d653522c35481653928f9268014f67c759b7"} Jul 07 19:49:28.313620 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.313599 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:28.338751 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.338731 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7392-140448517755792_ffaf81ab-e635-441c-b1f0-f62dcfdc6e39/test-curl-7392-140448517755792/0.log" Jul 07 19:49:28.367991 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.367961 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7392-140448517755792"] Jul 07 19:49:28.374862 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.374843 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7392-140448517755792"] Jul 07 19:49:28.433498 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.433423 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvw8h\" (UniqueName: \"kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h\") pod \"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39\" (UID: \"ffaf81ab-e635-441c-b1f0-f62dcfdc6e39\") " Jul 07 19:49:28.435688 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.435661 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h" (OuterVolumeSpecName: "kube-api-access-pvw8h") pod "ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" (UID: "ffaf81ab-e635-441c-b1f0-f62dcfdc6e39"). InnerVolumeSpecName "kube-api-access-pvw8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:49:28.534095 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:28.534063 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvw8h\" (UniqueName: \"kubernetes.io/projected/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39-kube-api-access-pvw8h\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:29.182624 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:29.182598 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:29.182775 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:29.182641 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c06d75e83bed03df5541f67a3b1d653522c35481653928f9268014f67c759b7" Jul 07 19:49:29.193000 ip-10-0-142-232 kubenswrapper[2576]: E0707 19:49:29.192971 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7392-140448517755792\" is forbidden: User \"system:node:ip-10-0-142-232.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-232.ec2.internal' and this object" podUID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" pod="opendatahub/test-curl-7392-140448517755792" Jul 07 19:49:30.230463 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:30.230418 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" path="/var/lib/kubelet/pods/ffaf81ab-e635-441c-b1f0-f62dcfdc6e39/volumes" Jul 07 19:49:39.157663 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:39.157625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:49:51.192919 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:51.192884 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:49:51.193349 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:51.193107 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" containerID="cri-o://122de2355895622ddf128f6fc871317204239052d4637d3cafa9537372d2d0e5" gracePeriod=30 Jul 07 19:49:53.871923 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:53.871841 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fzml6"] Jul 07 19:49:54.112547 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:54.112510 2576 patch_prober.go:28] interesting pod/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 19:49:54.112718 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:54.112575 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 19:49:56.337270 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.337239 2576 generic.go:356] "Generic (PLEG): container finished" podID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerID="122de2355895622ddf128f6fc871317204239052d4637d3cafa9537372d2d0e5" exitCode=0 Jul 07 19:49:56.337687 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.337315 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerDied","Data":"122de2355895622ddf128f6fc871317204239052d4637d3cafa9537372d2d0e5"} Jul 07 19:49:56.337687 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.337372 2576 scope.go:117] "RemoveContainer" containerID="3b56c3030e7290ff66da1c668b7a286035ac675b8f7402721d4734a6d3930f25" Jul 07 19:49:56.457155 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.457093 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:49:56.561498 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561443 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561525 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561544 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561589 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561609 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561637 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.561664 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561659 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.562027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561695 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7t2ht\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht\") pod \"97edb523-5f06-45be-b8ad-7ed711d149cf\" (UID: \"97edb523-5f06-45be-b8ad-7ed711d149cf\") " Jul 07 19:49:56.562027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561907 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:49:56.562027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.561926 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:49:56.562027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.562011 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.562246 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.562030 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-credential-socket\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.562246 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.562109 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:49:56.562407 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.562379 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 19:49:56.562865 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.562838 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data" (OuterVolumeSpecName: "istio-data") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:49:56.563810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.563786 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token" (OuterVolumeSpecName: "istio-token") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:49:56.563935 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.563919 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 19:49:56.564053 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.564037 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht" (OuterVolumeSpecName: "kube-api-access-7t2ht") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "kube-api-access-7t2ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 19:49:56.564096 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.564083 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "97edb523-5f06-45be-b8ad-7ed711d149cf" (UID: "97edb523-5f06-45be-b8ad-7ed711d149cf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 19:49:56.662861 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662835 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-data\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.662861 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662858 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-envoy\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.663025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662867 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-podinfo\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.663025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662877 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97edb523-5f06-45be-b8ad-7ed711d149cf-workload-certs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.663025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662885 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97edb523-5f06-45be-b8ad-7ed711d149cf-istiod-ca-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.663025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662893 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7t2ht\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-kube-api-access-7t2ht\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.663025 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.662901 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97edb523-5f06-45be-b8ad-7ed711d149cf-istio-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 07 19:49:56.803109 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:56.803036 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724210-wzftq_b5aafe59-efc5-4f01-b343-b10777d4f3a5/cleanup/0.log" Jul 07 19:49:57.344537 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.344509 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" Jul 07 19:49:57.344949 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.344557 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z" event={"ID":"97edb523-5f06-45be-b8ad-7ed711d149cf","Type":"ContainerDied","Data":"adfc74308abb6406897b8421e8cfb10f3e62410b4768d0a90d2f001f075c3167"} Jul 07 19:49:57.344949 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.344618 2576 scope.go:117] "RemoveContainer" containerID="122de2355895622ddf128f6fc871317204239052d4637d3cafa9537372d2d0e5" Jul 07 19:49:57.370611 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.370585 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:49:57.376379 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.376355 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-fe4a68-openshift-default-7df7f47cf-9d94z"] Jul 07 19:49:57.657433 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.657407 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8689849645-t2j5q_6b1f0a3f-060f-4de0-b9d8-720b1850e103/copy-manifests/0.log" Jul 07 19:49:57.679810 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:57.679763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8689849645-t2j5q_6b1f0a3f-060f-4de0-b9d8-720b1850e103/manager/0.log" Jul 07 19:49:58.230618 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.230587 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" path="/var/lib/kubelet/pods/97edb523-5f06-45be-b8ad-7ed711d149cf/volumes" Jul 07 19:49:58.599961 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.599871 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/util/0.log" Jul 07 19:49:58.609855 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.609825 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/pull/0.log" Jul 07 19:49:58.617977 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.617951 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/extract/0.log" Jul 07 19:49:58.730898 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.730870 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/pull/0.log" Jul 07 19:49:58.738509 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.738491 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/extract/0.log" Jul 07 19:49:58.756161 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.756136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/util/0.log" Jul 07 19:49:58.902314 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.902286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/util/0.log" Jul 07 19:49:58.927821 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.927797 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/pull/0.log" Jul 07 19:49:58.951872 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:58.951846 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/extract/0.log" Jul 07 19:49:59.078473 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.078429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/util/0.log" Jul 07 19:49:59.090194 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.090161 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/pull/0.log" Jul 07 19:49:59.097693 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.097672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/extract/0.log" Jul 07 19:49:59.388184 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.388153 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mw9mx_ee129719-5804-42fc-bd7f-df8e32022568/manager/0.log" Jul 07 19:49:59.758779 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.758672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zf6lm_336e66dc-1815-4479-87c4-595d90b1f481/registry-server/0.log" Jul 07 19:49:59.999073 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:49:59.999048 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fzml6_643e4847-5714-4f7c-a6e6-79fdd71c199c/limitador/0.log" Jul 07 19:50:00.128038 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:00.128013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7flwh_f40cba10-c4eb-4268-9a77-af182e439933/manager/0.log" Jul 07 19:50:00.658639 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:00.658605 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4rnqk_fefbc4be-1f0f-4de4-a824-1159f3433ab3/discovery/0.log" Jul 07 19:50:00.796346 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:00.796317 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c59bd5f-kdwqx_e870ab2f-9cd5-419c-aedd-8ab1cec04fcc/kube-auth-proxy/0.log" Jul 07 19:50:01.500530 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:01.500481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6559656f-x5jgr_979ebd18-6613-418e-aa59-ced8a44547b3/router/0.log" Jul 07 19:50:02.120641 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:02.120597 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nsxbz_b402143d-3688-453f-a985-642bcb221195/main/0.log" Jul 07 19:50:02.237370 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:02.237338 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbth8jt_233e5c17-9793-4e0b-beb7-e905382f17d4/main/0.log" Jul 07 19:50:10.289942 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:10.289902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bgjzx_22985704-9f1c-47ed-a6a9-58e6447b2ea0/global-pull-secret-syncer/0.log" Jul 07 19:50:10.520066 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:10.520032 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pm6nf_fd48f774-6c3f-4107-8697-62f6885ab890/konnectivity-agent/0.log" Jul 07 19:50:10.801273 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:10.801244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-232.ec2.internal_8fe84c148b4beb2400061983cd4783d3/haproxy/0.log" Jul 07 19:50:15.009493 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.009440 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/extract/0.log" Jul 07 19:50:15.049506 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.049447 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/util/0.log" Jul 07 19:50:15.083579 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.083554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j2rwf_07302bd1-408b-4e44-85a8-3708b9eda52b/pull/0.log" Jul 07 19:50:15.115405 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.115371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/extract/0.log" Jul 07 19:50:15.144924 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.144902 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/util/0.log" Jul 07 19:50:15.183994 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.183969 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e058kck_3d6b0aac-dcc2-42bd-bd79-1d4dc36871b6/pull/0.log" Jul 07 19:50:15.222967 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.222947 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/extract/0.log" Jul 07 19:50:15.252594 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.252575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/util/0.log" Jul 07 19:50:15.286245 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.286223 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7367prx_d8e325d4-173e-4378-87bc-6191ff25f1cc/pull/0.log" Jul 07 19:50:15.327736 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.327706 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/extract/0.log" Jul 07 19:50:15.359046 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.359020 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/util/0.log" Jul 07 19:50:15.401253 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.401172 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1tntmr_a72e512d-2608-4a0b-b5f8-843d6e702bab/pull/0.log" Jul 07 19:50:15.961097 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:15.961066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mw9mx_ee129719-5804-42fc-bd7f-df8e32022568/manager/0.log" Jul 07 19:50:16.099122 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:16.099084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zf6lm_336e66dc-1815-4479-87c4-595d90b1f481/registry-server/0.log" Jul 07 19:50:16.378994 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:16.378966 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fzml6_643e4847-5714-4f7c-a6e6-79fdd71c199c/limitador/0.log" Jul 07 19:50:16.485892 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:16.485867 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7flwh_f40cba10-c4eb-4268-9a77-af182e439933/manager/0.log" Jul 07 19:50:18.407004 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:18.406977 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-xcqd2_8fbd3b3b-e0cb-48c0-9a62-2fa8ba33c14f/cluster-monitoring-operator/0.log" Jul 07 19:50:18.621091 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:18.621060 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7txjt_3b867cf3-7c52-402c-b995-1a749f8080b0/node-exporter/0.log" Jul 07 19:50:18.652932 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:18.652905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7txjt_3b867cf3-7c52-402c-b995-1a749f8080b0/kube-rbac-proxy/0.log" Jul 07 19:50:18.679751 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:18.679687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7txjt_3b867cf3-7c52-402c-b995-1a749f8080b0/init-textfile/0.log" Jul 07 19:50:19.362981 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.362949 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-2pjvs_2621c54e-3290-4380-b313-83f07586240b/prometheus-operator-admission-webhook/0.log" Jul 07 19:50:19.942322 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942285 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d"] Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942655 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" containerName="test-curl-7392-140448517755792" Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942667 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" containerName="test-curl-7392-140448517755792" Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942691 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942696 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942702 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.942729 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942707 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.942920 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942763 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.942920 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942773 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffaf81ab-e635-441c-b1f0-f62dcfdc6e39" containerName="test-curl-7392-140448517755792" Jul 07 19:50:19.942920 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.942779 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="97edb523-5f06-45be-b8ad-7ed711d149cf" containerName="istio-proxy" Jul 07 19:50:19.945815 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.945798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:19.949840 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.949810 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpkhx\"/\"openshift-service-ca.crt\"" Jul 07 19:50:19.950279 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.950260 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpkhx\"/\"kube-root-ca.crt\"" Jul 07 19:50:19.961298 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.961259 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpkhx\"/\"default-dockercfg-x9f5v\"" Jul 07 19:50:19.968347 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:19.968321 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d"] Jul 07 19:50:20.057368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.057333 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-lib-modules\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.057368 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.057370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-sys\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.057625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.057504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-proc\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.057625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.057550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-podres\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.057625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.057603 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2hht\" (UniqueName: \"kubernetes.io/projected/bdc34e32-c03f-43b3-b57c-7945f914c8b7-kube-api-access-v2hht\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158737 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-lib-modules\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158737 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-sys\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-proc\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158792 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-podres\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158824 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2hht\" (UniqueName: \"kubernetes.io/projected/bdc34e32-c03f-43b3-b57c-7945f914c8b7-kube-api-access-v2hht\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158853 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-proc\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-sys\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-lib-modules\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.158973 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.158930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bdc34e32-c03f-43b3-b57c-7945f914c8b7-podres\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.169131 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.169109 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2hht\" (UniqueName: \"kubernetes.io/projected/bdc34e32-c03f-43b3-b57c-7945f914c8b7-kube-api-access-v2hht\") pod \"perf-node-gather-daemonset-bgh9d\" (UID: \"bdc34e32-c03f-43b3-b57c-7945f914c8b7\") " pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.256112 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.256028 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.393002 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.392977 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d"] Jul 07 19:50:20.394834 ip-10-0-142-232 kubenswrapper[2576]: W0707 19:50:20.394806 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbdc34e32_c03f_43b3_b57c_7945f914c8b7.slice/crio-ef12a6365984db094c59895ab8175f961d1d8f565690bcaa66ec9369024ded0e WatchSource:0}: Error finding container ef12a6365984db094c59895ab8175f961d1d8f565690bcaa66ec9369024ded0e: Status 404 returned error can't find the container with id ef12a6365984db094c59895ab8175f961d1d8f565690bcaa66ec9369024ded0e Jul 07 19:50:20.473523 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.473486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" event={"ID":"bdc34e32-c03f-43b3-b57c-7945f914c8b7","Type":"ContainerStarted","Data":"f29871f628c8d997797a0733a0964218762ead5494c1802844111c2d1ffd419b"} Jul 07 19:50:20.473634 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.473555 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" event={"ID":"bdc34e32-c03f-43b3-b57c-7945f914c8b7","Type":"ContainerStarted","Data":"ef12a6365984db094c59895ab8175f961d1d8f565690bcaa66ec9369024ded0e"} Jul 07 19:50:20.473719 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.473658 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:20.497571 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:20.497530 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" podStartSLOduration=1.497515238 podStartE2EDuration="1.497515238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:50:20.495739948 +0000 UTC m=+2538.713728587" watchObservedRunningTime="2026-07-07 19:50:20.497515238 +0000 UTC m=+2538.715503873" Jul 07 19:50:21.076731 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:21.076692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-psf9d_6f61a552-764d-46cd-bc84-b8d1fc7bbb3e/networking-console-plugin/0.log" Jul 07 19:50:21.639027 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:21.638989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/1.log" Jul 07 19:50:21.647036 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:21.647007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-xwwdx_e4550fd3-0ad9-4e90-824a-aa5ddd963ffd/console-operator/2.log" Jul 07 19:50:22.160837 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:22.160798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79c9648bb5-bf4cl_aade6493-c635-46b5-97d2-c32c95abebf1/console/0.log" Jul 07 19:50:22.209570 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:22.209548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-8ts4j_574f73e6-a7b4-421f-8d99-968793507a44/download-server/0.log" Jul 07 19:50:22.888896 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:22.888859 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hn6p7_c85eee24-fa6f-4f07-b4dc-31da091b7218/volume-data-source-validator/0.log" Jul 07 19:50:24.111143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:24.111113 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7rzd_2c71552c-07ac-49be-8d09-5273c6090945/dns/0.log" Jul 07 19:50:24.145907 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:24.145879 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7rzd_2c71552c-07ac-49be-8d09-5273c6090945/kube-rbac-proxy/0.log" Jul 07 19:50:24.331687 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:24.331655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6dj2_97d897b9-5540-4563-aeb8-0612ecd44f9f/dns-node-resolver/0.log" Jul 07 19:50:25.072338 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:25.072309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-scl5n_2dd7d4f5-0d21-426f-ae8e-c6d933f275a5/node-ca/0.log" Jul 07 19:50:26.435153 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:26.435120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4rnqk_fefbc4be-1f0f-4de4-a824-1159f3433ab3/discovery/0.log" Jul 07 19:50:26.469153 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:26.469127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c59bd5f-kdwqx_e870ab2f-9cd5-419c-aedd-8ab1cec04fcc/kube-auth-proxy/0.log" Jul 07 19:50:26.489576 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:26.489554 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpkhx/perf-node-gather-daemonset-bgh9d" Jul 07 19:50:26.794625 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:26.794538 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6559656f-x5jgr_979ebd18-6613-418e-aa59-ced8a44547b3/router/0.log" Jul 07 19:50:27.562561 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:27.562535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qqrjk_e1da7afd-36dc-4e42-bb9e-fba66fbce76c/serve-healthcheck-canary/0.log" Jul 07 19:50:28.149616 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:28.149587 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xxw5w_153b3d70-310e-4e2f-93e4-d9644d890f76/insights-operator/0.log" Jul 07 19:50:28.150114 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:28.150096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xxw5w_153b3d70-310e-4e2f-93e4-d9644d890f76/insights-operator/1.log" Jul 07 19:50:28.187305 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:28.187280 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnz8s_1069f994-77b2-4189-b34d-97408bf6231b/kube-rbac-proxy/0.log" Jul 07 19:50:28.218524 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:28.218501 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnz8s_1069f994-77b2-4189-b34d-97408bf6231b/exporter/0.log" Jul 07 19:50:28.251711 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:28.251690 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gnz8s_1069f994-77b2-4189-b34d-97408bf6231b/extractor/0.log" Jul 07 19:50:30.504633 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:30.504603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4rnqk_fefbc4be-1f0f-4de4-a824-1159f3433ab3/discovery/0.log" Jul 07 19:50:30.525883 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:30.525855 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c59bd5f-kdwqx_e870ab2f-9cd5-419c-aedd-8ab1cec04fcc/kube-auth-proxy/0.log" Jul 07 19:50:30.757143 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:30.757067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6559656f-x5jgr_979ebd18-6613-418e-aa59-ced8a44547b3/router/0.log" Jul 07 19:50:31.470791 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:31.470764 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724210-wzftq_b5aafe59-efc5-4f01-b343-b10777d4f3a5/cleanup/0.log" Jul 07 19:50:32.171508 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:32.171473 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8689849645-t2j5q_6b1f0a3f-060f-4de0-b9d8-720b1850e103/manager/0.log" Jul 07 19:50:32.223572 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:32.223535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8689849645-t2j5q_6b1f0a3f-060f-4de0-b9d8-720b1850e103/copy-manifests/0.log" Jul 07 19:50:32.292329 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:32.292288 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4rnqk_fefbc4be-1f0f-4de4-a824-1159f3433ab3/discovery/0.log" Jul 07 19:50:32.308105 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:32.308074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c59bd5f-kdwqx_e870ab2f-9cd5-419c-aedd-8ab1cec04fcc/kube-auth-proxy/0.log" Jul 07 19:50:32.552684 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:32.552597 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c6559656f-x5jgr_979ebd18-6613-418e-aa59-ced8a44547b3/router/0.log" Jul 07 19:50:33.719568 ip-10-0-142-232 kubenswrapper[2576]: I0707 19:50:33.719534 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cjmzs_8e191807-ae79-4728-8c76-12c5f5886360/openshift-lws-operator/0.log"