Jul 18 00:40:34.178706 ip-10-0-130-15 systemd[1]: Starting Kubernetes Kubelet... Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.564500 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569225 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569236 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569240 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569243 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569246 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569249 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569252 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.598914 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569255 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569258 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569263 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569267 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569270 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569273 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569276 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569279 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569281 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569285 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569287 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569290 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569293 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569295 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569298 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569302 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569317 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569320 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569324 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.600387 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569328 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569331 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569334 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569336 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569339 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569342 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569344 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569347 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569350 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569353 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569355 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569357 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569360 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569363 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569366 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569368 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569371 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569373 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569376 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569380 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.601755 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569383 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569385 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569388 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569391 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569393 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569396 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569398 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569401 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569404 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569406 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569409 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569411 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569414 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569416 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569419 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569421 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569424 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569427 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569429 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569432 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.602662 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569434 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569437 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569440 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569442 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569446 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569449 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569452 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569454 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569456 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569459 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569462 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569465 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569467 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569470 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569472 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569475 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569477 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569480 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569482 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569486 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.603555 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569490 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569493 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569495 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569498 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569500 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569503 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569505 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569508 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569511 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569514 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569517 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569520 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.569522 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570811 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570818 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570822 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570826 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570830 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570833 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570836 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.605698 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570839 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570841 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570845 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570849 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570853 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570857 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570860 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570863 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570865 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570868 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570871 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570874 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570877 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570879 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570882 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570885 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570889 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570892 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570895 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.606551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570898 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570901 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570903 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570906 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570909 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570912 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570914 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570917 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570920 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570924 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570927 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570930 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570933 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570935 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570938 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570942 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570947 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570950 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570953 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570956 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.608046 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570958 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570961 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570963 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570966 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570969 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570971 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570974 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570976 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570979 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570982 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570984 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570987 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570989 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570992 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570994 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.570997 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571000 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571003 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571005 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571008 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.608911 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571012 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571014 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571017 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571020 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571022 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571025 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571028 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571030 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571033 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571036 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571038 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571041 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571046 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571048 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571050 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571053 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571056 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571058 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571060 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.610620 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571063 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571065 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571069 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571071 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571074 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571076 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571079 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571081 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571084 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571087 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571089 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571092 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571094 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571097 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571497 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571503 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571507 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571510 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571513 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571515 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.611485 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571518 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571521 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571524 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571527 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571530 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571535 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571538 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571540 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571543 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571546 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571548 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571551 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571554 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571557 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571559 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571562 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571565 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571567 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571570 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571572 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.612551 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571575 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571578 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571582 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571584 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571587 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571590 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571594 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571597 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571600 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571604 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571606 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571609 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571612 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571615 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571617 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571620 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571624 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571629 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.613412 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571632 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571635 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571637 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571640 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571643 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571645 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571649 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571651 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571654 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571657 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571659 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571662 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571665 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571667 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571670 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571672 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571675 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571678 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571680 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571683 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.614274 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571686 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571688 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571691 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571693 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571696 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571698 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571702 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571704 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571707 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571710 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571712 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571716 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571720 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571723 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571725 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571728 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571730 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571733 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571735 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571738 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.615134 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571740 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571743 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571745 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571748 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571750 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571753 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571755 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571758 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571761 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571763 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571766 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571768 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571771 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571774 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.571776 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571843 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571852 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571860 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571866 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571873 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571878 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 00:40:34.616002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571884 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571890 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571898 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571903 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571906 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571909 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571912 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571915 2581 flags.go:64] FLAG: --cgroup-root="" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571918 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571921 2581 flags.go:64] FLAG: --client-ca-file="" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571924 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571927 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571931 2581 flags.go:64] FLAG: --cluster-domain="" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571934 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571937 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571940 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571944 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571947 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571950 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571953 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571956 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571959 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571962 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571965 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 00:40:34.617074 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571968 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571971 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571975 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571978 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571981 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571984 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571987 2581 flags.go:64] FLAG: --enable-server="true" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571990 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571994 2581 flags.go:64] FLAG: --event-burst="100" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.571997 2581 flags.go:64] FLAG: --event-qps="50" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572001 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572006 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572009 2581 flags.go:64] FLAG: --eviction-hard="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572013 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572015 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572018 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572021 2581 flags.go:64] FLAG: --eviction-soft="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572024 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572027 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572030 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572033 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572036 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572038 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572041 2581 flags.go:64] FLAG: --feature-gates="" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572045 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 00:40:34.618155 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572048 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572051 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572054 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572057 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572060 2581 flags.go:64] FLAG: --help="false" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572063 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-15.ec2.internal" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572066 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572069 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572071 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572075 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572078 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572082 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572084 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572087 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572090 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572093 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572096 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572101 2581 flags.go:64] FLAG: --kube-reserved="" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572105 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572108 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572111 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572114 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572117 2581 flags.go:64] FLAG: --lock-file="" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572120 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 00:40:34.619259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572123 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572126 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572131 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572134 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572137 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572140 2581 flags.go:64] FLAG: --logging-format="text" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572142 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572146 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572149 2581 flags.go:64] FLAG: --manifest-url="" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572152 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572156 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572159 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572162 2581 flags.go:64] FLAG: --max-pods="110" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572165 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572168 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572171 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572174 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572177 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572179 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572182 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572189 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572193 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572196 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 00:40:34.620562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572199 2581 flags.go:64] FLAG: --pod-cidr="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572201 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572207 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572211 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572215 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572219 2581 flags.go:64] FLAG: --port="10250" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572223 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572225 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0641b5c4b96c0e4ba" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572229 2581 flags.go:64] FLAG: --qos-reserved="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572231 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572234 2581 flags.go:64] FLAG: --register-node="true" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572237 2581 flags.go:64] FLAG: --register-with-taints="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572241 2581 flags.go:64] FLAG: --registry-burst="10" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572244 2581 flags.go:64] FLAG: --registry-qps="5" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572247 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572249 2581 flags.go:64] FLAG: --reserved-memory="" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572253 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572256 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572259 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572262 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572265 2581 flags.go:64] FLAG: --runonce="false" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572268 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572271 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572274 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572277 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 00:40:34.623081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572279 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572282 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572286 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572289 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572291 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572294 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572297 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572300 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572302 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572317 2581 flags.go:64] FLAG: --system-cgroups="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572323 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572328 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572331 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572334 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572339 2581 flags.go:64] FLAG: --tls-min-version="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572342 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572344 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572347 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572350 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572353 2581 flags.go:64] FLAG: --v="2" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572357 2581 flags.go:64] FLAG: --version="false" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572361 2581 flags.go:64] FLAG: --vmodule="" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572364 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.572368 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572486 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.624722 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572489 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572492 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572495 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572497 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572500 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572503 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572505 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572508 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572511 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572513 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572516 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572518 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572521 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572524 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572526 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572529 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572531 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572536 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572539 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572542 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.625442 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572544 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572547 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572550 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572553 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572555 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572558 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572560 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572563 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572565 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572568 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572570 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572573 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572575 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572578 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572580 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572583 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572585 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572588 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572590 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572593 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.626177 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572596 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572598 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572601 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572603 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572606 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572608 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572611 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572613 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572616 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572621 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572624 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572627 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572629 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572632 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572635 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572638 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572641 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572646 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572648 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.626780 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572651 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572654 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572656 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572658 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572661 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572664 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572666 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572669 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572671 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572674 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572677 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572681 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572685 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572689 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572692 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572695 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572698 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572701 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572703 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.627481 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572706 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572709 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572716 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572719 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572722 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572724 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572727 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572730 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572733 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572735 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572737 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572740 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572743 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572745 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572748 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572750 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572753 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572755 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.628031 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.572758 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.573325 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.580745 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.580762 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.580779 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.580788 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580844 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580849 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580852 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580855 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580858 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580861 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580863 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580866 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.628567 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580869 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580872 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580874 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580877 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580879 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580882 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580884 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580887 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580890 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580892 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580895 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580898 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580900 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580903 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580905 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580908 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580910 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580916 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580918 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580921 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.628971 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580923 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580928 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580932 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580935 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580938 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580941 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580944 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580947 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580949 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580952 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580954 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580957 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580960 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580962 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580966 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580969 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580972 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580975 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580977 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.760154 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580980 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.662335 ip-10-0-130-15 systemd[1]: Started Kubernetes Kubelet. Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580983 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580985 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580987 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580990 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580992 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580995 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.580998 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581001 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581003 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581007 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581010 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581013 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581017 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581021 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581024 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581027 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581029 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581032 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581034 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.761108 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581037 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581040 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581042 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581045 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581047 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581050 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581052 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581055 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581058 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581060 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581063 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581065 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581068 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581071 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581073 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581076 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581078 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581081 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581084 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581086 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.761953 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581088 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581091 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581095 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581098 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581100 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581103 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581106 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581108 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581111 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581114 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581116 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581119 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.581124 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581235 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581240 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:40:34.762618 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581243 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581246 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581249 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581252 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581254 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581257 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581260 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581262 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581265 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581267 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581270 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581273 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581275 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581278 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581280 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581283 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581285 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581288 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581290 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581293 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:40:34.763121 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581296 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581299 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581302 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581322 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581325 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581328 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581331 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581334 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581336 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581339 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581342 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581344 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581347 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581350 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581352 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581355 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581358 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581362 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581365 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:40:34.763903 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581368 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581371 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581374 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581376 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581379 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581381 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581384 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581386 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581389 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581391 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581394 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581397 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581399 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581404 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581406 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581409 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581415 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581417 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581420 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:40:34.764521 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581423 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581428 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581431 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581434 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581437 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581439 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581442 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581445 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581448 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581451 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581454 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581456 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581459 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581461 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581464 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581466 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581469 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581472 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581475 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:40:34.765164 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581477 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581480 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581482 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581485 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581487 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581490 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581492 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581496 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581499 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581501 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581506 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581508 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581511 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581514 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581516 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581519 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581522 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581524 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581527 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:40:34.765767 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:34.581530 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.581535 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.581660 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.584082 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.585576 2581 server.go:1019] "Starting client certificate rotation" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.585676 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.585714 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.587543 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.589031 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.617512 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.632058 2581 log.go:25] "Validated CRI v1 runtime API" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.634448 2581 log.go:25] "Validated CRI v1 image API" Jul 18 00:40:34.768122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.635622 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpvkb" Jul 18 00:40:34.783881 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.636041 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 00:40:34.783881 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.638228 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 90d2b974-561c-4131-8a1c-932c50a41148:/dev/nvme0n1p3 f6506a06-6784-4144-91c7-01f3de0ecc32:/dev/nvme0n1p4] Jul 18 00:40:34.783881 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.638248 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 00:40:34.783881 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.643246 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xpvkb" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.643888 2581 manager.go:216] Machine: {Timestamp:2026-07-18 00:40:34.642679742 +0000 UTC m=+0.343546756 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101089 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dcbf7791e924a77abfda4e2931c5a SystemUUID:ec2dcbf7-791e-924a-77ab-fda4e2931c5a BootID:7386af56-a09e-4854-8a0b-a108fe4324e0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:18:54:12:15 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:18:54:12:15 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:1a:51:14:59:93 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.643990 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.644100 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.645141 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.645168 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-15.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.645950 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.645960 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.645967 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.646493 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.648069 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651014 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651131 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651158 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651170 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651191 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651205 2581 kubelet.go:398] "Adding apiserver pod source" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651216 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 00:40:34.784387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651638 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.651662 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.654242 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.656342 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.656406 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657346 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657360 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657366 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657373 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657382 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657388 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657396 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657401 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657408 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657414 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657428 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.657433 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.658061 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.658067 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.661281 2581 server.go:1268] "Started kubelet" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.661575 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.661523 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.662199 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.667644 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.667926 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.669979 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.672100 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.672323 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.673343 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-15.ec2.internal" not found Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.678355 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.678519 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.679081 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-15.ec2.internal\" not found" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.679530 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.679547 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.679769 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.679839 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.679848 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.680902 2581 factory.go:55] Registering systemd factory Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.680917 2581 factory.go:223] Registration of the systemd container factory successfully Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681149 2581 factory.go:153] Registering CRI-O factory Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681168 2581 factory.go:223] Registration of the crio container factory successfully Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681230 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681263 2581 factory.go:103] Registering Raw factory Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681281 2581 manager.go:1196] Started watching for new ooms in manager Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681836 2581 manager.go:349] Starting recovery of all containers Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.681998 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.688657 2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-15.ec2.internal\" not found" node="ip-10-0-130-15.ec2.internal" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.689608 2581 manager.go:354] Recovery completed Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.693401 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695184 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695217 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695233 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:34.784996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695650 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695658 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695674 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.695747 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696530 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696567 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696593 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696858 2581 policy_none.go:49] "None policy: Start" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696876 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696891 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.696905 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-15.ec2.internal" not found Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.697826 2581 policy_none.go:47] "Start" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.739635 2581 manager.go:337] "Starting Device Plugin manager" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.739818 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.739831 2581 server.go:87] "Starting device plugin registration server" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.740025 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.740035 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.740126 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.740205 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.740215 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.741511 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.741553 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-15.ec2.internal\" not found" Jul 18 00:40:34.786681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.755924 2581 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-130-15.ec2.internal" not found Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.827226 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.828431 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.828490 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.828517 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.828556 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.830462 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.841083 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.841886 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.841921 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.841938 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.841961 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-15.ec2.internal" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.847766 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-15.ec2.internal" Jul 18 00:40:34.919892 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:34.847787 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-15.ec2.internal\": node \"ip-10-0-130-15.ec2.internal\" not found" Jul 18 00:40:34.929872 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.929126 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal"] Jul 18 00:40:34.931203 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.930627 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:34.932339 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.931548 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.981361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.981393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.981440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a82543545f703d857cb6e9837878f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-15.ec2.internal\" (UID: \"29a82543545f703d857cb6e9837878f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.986922 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:34.990519 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.001427 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:40:35.039668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.002089 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a82543545f703d857cb6e9837878f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-15.ec2.internal\" (UID: \"29a82543545f703d857cb6e9837878f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082181 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/29a82543545f703d857cb6e9837878f6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-15.ec2.internal\" (UID: \"29a82543545f703d857cb6e9837878f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.172235 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.082180 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0692625a5b4ef6f547aa57e34a54c15a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal\" (UID: \"0692625a5b4ef6f547aa57e34a54c15a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.342647 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.306427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.342647 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.308644 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.587376 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.587595 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.587595 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.587620 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.647712 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:35:34 +0000 UTC" deadline="2028-04-27 14:21:08.656615258 +0000 UTC" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.647776 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15589h40m33.008849891s" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.654391 2581 apiserver.go:52] "Watching apiserver" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.662046 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.662416 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-svr22","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp","openshift-dns/node-resolver-9k4sj","openshift-multus/multus-bfb8q","openshift-multus/network-metrics-daemon-7vk48","openshift-network-operator/iptables-alerter-9f9bj","openshift-ovn-kubernetes/ovnkube-node-qt8nd","kube-system/global-pull-secret-syncer-r4jbh","kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8qvrc","openshift-image-registry/node-ca-665j9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal","openshift-multus/multus-additional-cni-plugins-5nbk2","openshift-network-diagnostics/network-check-target-7qvbq"] Jul 18 00:40:35.667950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.665008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.684822 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.684838 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.684829 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.684830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x6gwb\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.685704 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.685860 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-device-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fdpv\" (UniqueName: \"kubernetes.io/projected/b6400620-39ec-4eaf-910a-4ffa5607175e-kube-api-access-4fdpv\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688347 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d83e1961-e070-4cac-9e8c-e705452b0511-agent-certs\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688380 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d83e1961-e070-4cac-9e8c-e705452b0511-konnectivity-ca\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-socket-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/130041cd-4239-4c21-b63d-2efd8ac81a49-hosts-file\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-registration-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-sys-fs\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130041cd-4239-4c21-b63d-2efd8ac81a49-tmp-dir\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fld6\" (UniqueName: \"kubernetes.io/projected/130041cd-4239-4c21-b63d-2efd8ac81a49-kube-api-access-2fld6\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688883 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.688972 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.689035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h6q29\"" Jul 18 00:40:35.770172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.689181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.690773 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.691825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.691895 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.691980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-brvm5\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.692238 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.692296 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.692992 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.693013 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.693163 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s2rdz\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.693302 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.693377 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.693662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.695375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.695544 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.695606 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.695768 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.696057 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x2zbl\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.696060 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.696552 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.696605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.697650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.697684 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b48gg\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.697741 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.698038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.698072 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.699024 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.699577 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.699743 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.699784 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.699983 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-w9cl5\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.700031 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.700112 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.700327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.700941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 00:40:35.771296 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.701239 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4bdjh\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.701428 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.701522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.701565 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.701662 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.702732 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cfrqw\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.702954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.703110 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.718419 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4nh24" Jul 18 00:40:35.772930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.727667 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4nh24" Jul 18 00:40:35.781139 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.781116 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 00:40:35.789651 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-sys\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.789651 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-multus\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.789825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-registration-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.789825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fk66\" (UniqueName: \"kubernetes.io/projected/f0777511-657d-4e41-847c-1869afd0dbd3-kube-api-access-9fk66\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.789825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-etc-kubernetes\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789831 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-registration-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-slash\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789873 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-netns\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-ovn\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67549c68-7007-460f-818e-ffecdd166d07-host\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.789964 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.790001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-device-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790029 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790083 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-device-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cnibin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-host\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790184 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-conf-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790199 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-daemon-config\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-systemd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790269 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790289 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6xnq\" (UniqueName: \"kubernetes.io/projected/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-kube-api-access-f6xnq\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790340 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysconfig\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-run\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790378 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-var-lib-kubelet\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-hostroot\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790406 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-multus-certs\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790443 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2hc4\" (UniqueName: \"kubernetes.io/projected/4c6778b5-044f-4a9b-bd04-c8980a63e6be-kube-api-access-j2hc4\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790468 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-dbus\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-modprobe-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-conf\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-os-release\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790556 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w865w\" (UniqueName: \"kubernetes.io/projected/98a3d987-e06e-4448-83dc-4f285ec1a5c1-kube-api-access-w865w\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67549c68-7007-460f-818e-ffecdd166d07-serviceca\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790609 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4qh\" (UniqueName: \"kubernetes.io/projected/67549c68-7007-460f-818e-ffecdd166d07-kube-api-access-hw4qh\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.790712 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-iptables-alerter-script\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790640 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-kubernetes\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790656 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-script-lib\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd8kk\" (UniqueName: \"kubernetes.io/projected/d3ad45a2-8123-4535-84bd-d327227dc6eb-kube-api-access-xd8kk\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f22xc\" (UniqueName: \"kubernetes.io/projected/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-kube-api-access-f22xc\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-tmp\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cni-binary-copy\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790754 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-systemd-units\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-node-log\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130041cd-4239-4c21-b63d-2efd8ac81a49-tmp-dir\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790839 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790861 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-socket-dir-parent\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-netns\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790891 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-etc-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790939 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-log-socket\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-kubelet\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.791519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.790998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-kubelet\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791022 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-bin\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d83e1961-e070-4cac-9e8c-e705452b0511-agent-certs\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-os-release\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-system-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791149 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-k8s-cni-cncf-io\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d83e1961-e070-4cac-9e8c-e705452b0511-konnectivity-ca\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/130041cd-4239-4c21-b63d-2efd8ac81a49-hosts-file\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/130041cd-4239-4c21-b63d-2efd8ac81a49-hosts-file\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791355 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-system-cni-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791412 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791440 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-lib-modules\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.792413 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-sys-fs\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fld6\" (UniqueName: \"kubernetes.io/projected/130041cd-4239-4c21-b63d-2efd8ac81a49-kube-api-access-2fld6\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791552 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-cnibin\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791577 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-sys-fs\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791594 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-etc-tuned\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791615 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-var-lib-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-env-overrides\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791801 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fdpv\" (UniqueName: \"kubernetes.io/projected/b6400620-39ec-4eaf-910a-4ffa5607175e-kube-api-access-4fdpv\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d83e1961-e070-4cac-9e8c-e705452b0511-konnectivity-ca\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791838 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-host-slash\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-bin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.791991 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-kubelet-config\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-netd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792077 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-config\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.792999 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovn-node-metrics-cert\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.793566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-socket-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.793566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792155 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-systemd\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.793566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/130041cd-4239-4c21-b63d-2efd8ac81a49-tmp-dir\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.793566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.792293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6400620-39ec-4eaf-910a-4ffa5607175e-socket-dir\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.795009 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.794991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d83e1961-e070-4cac-9e8c-e705452b0511-agent-certs\") pod \"konnectivity-agent-svr22\" (UID: \"d83e1961-e070-4cac-9e8c-e705452b0511\") " pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:35.799129 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.799111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fdpv\" (UniqueName: \"kubernetes.io/projected/b6400620-39ec-4eaf-910a-4ffa5607175e-kube-api-access-4fdpv\") pod \"aws-ebs-csi-driver-node-ml2fp\" (UID: \"b6400620-39ec-4eaf-910a-4ffa5607175e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:35.799927 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.799909 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fld6\" (UniqueName: \"kubernetes.io/projected/130041cd-4239-4c21-b63d-2efd8ac81a49-kube-api-access-2fld6\") pod \"node-resolver-9k4sj\" (UID: \"130041cd-4239-4c21-b63d-2efd8ac81a49\") " pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:35.893498 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fk66\" (UniqueName: \"kubernetes.io/projected/f0777511-657d-4e41-847c-1869afd0dbd3-kube-api-access-9fk66\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893511 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-etc-kubernetes\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-slash\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-netns\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-ovn\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-etc-kubernetes\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67549c68-7007-460f-818e-ffecdd166d07-host\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.893709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893689 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-ovn\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893710 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-slash\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-netns\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67549c68-7007-460f-818e-ffecdd166d07-host\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893817 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cnibin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893887 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cnibin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-host\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-conf-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-daemon-config\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-systemd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893983 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.893997 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-host\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894019 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-conf-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894036 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6xnq\" (UniqueName: \"kubernetes.io/projected/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-kube-api-access-f6xnq\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysconfig\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894072 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-systemd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-run\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-var-lib-kubelet\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-hostroot\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894159 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894171 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-multus-certs\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894198 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2hc4\" (UniqueName: \"kubernetes.io/projected/4c6778b5-044f-4a9b-bd04-c8980a63e6be-kube-api-access-j2hc4\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894220 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-var-lib-kubelet\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894225 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-dbus\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894282 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-modprobe-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-multus-certs\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894297 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-run\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-conf\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894392 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-binary-copy\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-os-release\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.894825 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-hostroot\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w865w\" (UniqueName: \"kubernetes.io/projected/98a3d987-e06e-4448-83dc-4f285ec1a5c1-kube-api-access-w865w\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-conf\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894505 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67549c68-7007-460f-818e-ffecdd166d07-serviceca\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894549 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4qh\" (UniqueName: \"kubernetes.io/projected/67549c68-7007-460f-818e-ffecdd166d07-kube-api-access-hw4qh\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-daemon-config\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-iptables-alerter-script\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-kubernetes\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-os-release\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-script-lib\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894730 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysconfig\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894829 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-modprobe-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd8kk\" (UniqueName: \"kubernetes.io/projected/d3ad45a2-8123-4535-84bd-d327227dc6eb-kube-api-access-xd8kk\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.894878 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-kubernetes\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895029 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-dbus\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/67549c68-7007-460f-818e-ffecdd166d07-serviceca\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.895688 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f22xc\" (UniqueName: \"kubernetes.io/projected/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-kube-api-access-f22xc\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-tmp\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3ad45a2-8123-4535-84bd-d327227dc6eb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cni-binary-copy\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-systemd-units\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-node-log\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895251 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-systemd-units\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-socket-dir-parent\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895309 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-netns\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-etc-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895377 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-socket-dir-parent\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.895398 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895420 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-run-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-log-socket\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-iptables-alerter-script\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-kubelet\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.896545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895311 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-node-log\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895477 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-etc-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-log-socket\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.895511 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.395475526 +0000 UTC m=+2.096342531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-kubelet\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-kubelet\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895511 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-netns\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895581 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-kubelet\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-bin\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895639 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-os-release\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895679 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-bin\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-system-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-k8s-cni-cncf-io\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-script-lib\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895754 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-os-release\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98a3d987-e06e-4448-83dc-4f285ec1a5c1-cni-binary-copy\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.897334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895774 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-system-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-system-cni-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.895790 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895798 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-system-cni-dir\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895766 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-run-k8s-cni-cncf-io\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.895861 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.395842303 +0000 UTC m=+2.096709317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-lib-modules\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895924 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895945 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-sysctl-d\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.895983 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-cnibin\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896005 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-multus-cni-dir\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-etc-tuned\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896030 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-lib-modules\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896059 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3ad45a2-8123-4535-84bd-d327227dc6eb-cnibin\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-var-lib-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.898259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896124 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-env-overrides\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896143 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-var-lib-openvswitch\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-host-slash\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-bin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896210 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-kubelet-config\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-host-slash\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-netd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5861b829-9730-49e3-9359-db5f78ffe35c-kubelet-config\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-run-ovn-kubernetes\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896239 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-bin\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-config\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c6778b5-044f-4a9b-bd04-c8980a63e6be-host-cni-netd\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovn-node-metrics-cert\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-systemd\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-sys\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-multus\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.899204 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.896970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-env-overrides\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.900117 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.897053 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/98a3d987-e06e-4448-83dc-4f285ec1a5c1-host-var-lib-cni-multus\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.900117 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.897121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-sys\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.900117 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.897177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0777511-657d-4e41-847c-1869afd0dbd3-etc-systemd\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.901271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.900389 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovn-node-metrics-cert\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.901271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.900485 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c6778b5-044f-4a9b-bd04-c8980a63e6be-ovnkube-config\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.901271 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.900630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-tmp\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.901859 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.901793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0777511-657d-4e41-847c-1869afd0dbd3-etc-tuned\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.902952 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.902925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fk66\" (UniqueName: \"kubernetes.io/projected/f0777511-657d-4e41-847c-1869afd0dbd3-kube-api-access-9fk66\") pod \"tuned-8qvrc\" (UID: \"f0777511-657d-4e41-847c-1869afd0dbd3\") " pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:35.903484 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.903443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4qh\" (UniqueName: \"kubernetes.io/projected/67549c68-7007-460f-818e-ffecdd166d07-kube-api-access-hw4qh\") pod \"node-ca-665j9\" (UID: \"67549c68-7007-460f-818e-ffecdd166d07\") " pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:35.904033 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.904006 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2hc4\" (UniqueName: \"kubernetes.io/projected/4c6778b5-044f-4a9b-bd04-c8980a63e6be-kube-api-access-j2hc4\") pod \"ovnkube-node-qt8nd\" (UID: \"4c6778b5-044f-4a9b-bd04-c8980a63e6be\") " pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:35.904114 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.904031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6xnq\" (UniqueName: \"kubernetes.io/projected/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-kube-api-access-f6xnq\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:35.904157 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.904113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w865w\" (UniqueName: \"kubernetes.io/projected/98a3d987-e06e-4448-83dc-4f285ec1a5c1-kube-api-access-w865w\") pod \"multus-bfb8q\" (UID: \"98a3d987-e06e-4448-83dc-4f285ec1a5c1\") " pod="openshift-multus/multus-bfb8q" Jul 18 00:40:35.905473 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.905451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd8kk\" (UniqueName: \"kubernetes.io/projected/d3ad45a2-8123-4535-84bd-d327227dc6eb-kube-api-access-xd8kk\") pod \"multus-additional-cni-plugins-5nbk2\" (UID: \"d3ad45a2-8123-4535-84bd-d327227dc6eb\") " pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:35.907420 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.907397 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:35.907420 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.907423 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:35.907542 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.907433 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:35.907542 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:35.907482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:36.407468543 +0000 UTC m=+2.108335542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:35.909142 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.909121 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f22xc\" (UniqueName: \"kubernetes.io/projected/1ac0a18d-fe84-40d6-8d10-52ac3886b0a0-kube-api-access-f22xc\") pod \"iptables-alerter-9f9bj\" (UID: \"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0\") " pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:35.953779 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:35.953746 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a82543545f703d857cb6e9837878f6.slice/crio-829cde7656153b7c35668de1614465a5832c820e68855a208b3c04e0cb743e67 WatchSource:0}: Error finding container 829cde7656153b7c35668de1614465a5832c820e68855a208b3c04e0cb743e67: Status 404 returned error can't find the container with id 829cde7656153b7c35668de1614465a5832c820e68855a208b3c04e0cb743e67 Jul 18 00:40:35.955909 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:35.955889 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0692625a5b4ef6f547aa57e34a54c15a.slice/crio-40c28bcea93a409b4dbdd54dbed8831876521e1c7a9f7a0bef62e27a428c5afe WatchSource:0}: Error finding container 40c28bcea93a409b4dbdd54dbed8831876521e1c7a9f7a0bef62e27a428c5afe: Status 404 returned error can't find the container with id 40c28bcea93a409b4dbdd54dbed8831876521e1c7a9f7a0bef62e27a428c5afe Jul 18 00:40:35.959844 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:35.959829 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:40:36.019132 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.019099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" Jul 18 00:40:36.029355 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.029329 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6400620_39ec_4eaf_910a_4ffa5607175e.slice/crio-f5c37d4e3cd92cd24ad777f10dfa35d7ed0094934a5f8217243f12a81abe064f WatchSource:0}: Error finding container f5c37d4e3cd92cd24ad777f10dfa35d7ed0094934a5f8217243f12a81abe064f: Status 404 returned error can't find the container with id f5c37d4e3cd92cd24ad777f10dfa35d7ed0094934a5f8217243f12a81abe064f Jul 18 00:40:36.050963 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.050905 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:36.059492 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.059464 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83e1961_e070_4cac_9e8c_e705452b0511.slice/crio-10d896a3f5b3c4de74fb048b70ab5b876bd168d426cd6bd1f9412f61c662653c WatchSource:0}: Error finding container 10d896a3f5b3c4de74fb048b70ab5b876bd168d426cd6bd1f9412f61c662653c: Status 404 returned error can't find the container with id 10d896a3f5b3c4de74fb048b70ab5b876bd168d426cd6bd1f9412f61c662653c Jul 18 00:40:36.088547 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.088509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9k4sj" Jul 18 00:40:36.097326 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.097285 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130041cd_4239_4c21_b63d_2efd8ac81a49.slice/crio-d1f4919125aa05ec96232cbff48b3ad8fbf6df32eae90425d235d1b34bff35bb WatchSource:0}: Error finding container d1f4919125aa05ec96232cbff48b3ad8fbf6df32eae90425d235d1b34bff35bb: Status 404 returned error can't find the container with id d1f4919125aa05ec96232cbff48b3ad8fbf6df32eae90425d235d1b34bff35bb Jul 18 00:40:36.108916 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.108895 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfb8q" Jul 18 00:40:36.118011 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.117985 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a3d987_e06e_4448_83dc_4f285ec1a5c1.slice/crio-0697227aa11554a04b8aebfee3ac5feb17913103e7376525084f15e2e5ae4bcd WatchSource:0}: Error finding container 0697227aa11554a04b8aebfee3ac5feb17913103e7376525084f15e2e5ae4bcd: Status 404 returned error can't find the container with id 0697227aa11554a04b8aebfee3ac5feb17913103e7376525084f15e2e5ae4bcd Jul 18 00:40:36.131422 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.131395 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9f9bj" Jul 18 00:40:36.137778 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.137759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:40:36.140303 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.140279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac0a18d_fe84_40d6_8d10_52ac3886b0a0.slice/crio-6c1bf900be67ddca9adc9b0df8ec04545653db91664194194343c3a9e20b46d1 WatchSource:0}: Error finding container 6c1bf900be67ddca9adc9b0df8ec04545653db91664194194343c3a9e20b46d1: Status 404 returned error can't find the container with id 6c1bf900be67ddca9adc9b0df8ec04545653db91664194194343c3a9e20b46d1 Jul 18 00:40:36.148579 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.148558 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c6778b5_044f_4a9b_bd04_c8980a63e6be.slice/crio-6e91b2e50cdadbe8bd76e913a3b275c63fc55c3bcce97b18f16e6f5ff5819903 WatchSource:0}: Error finding container 6e91b2e50cdadbe8bd76e913a3b275c63fc55c3bcce97b18f16e6f5ff5819903: Status 404 returned error can't find the container with id 6e91b2e50cdadbe8bd76e913a3b275c63fc55c3bcce97b18f16e6f5ff5819903 Jul 18 00:40:36.164748 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.164729 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" Jul 18 00:40:36.174181 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.174157 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0777511_657d_4e41_847c_1869afd0dbd3.slice/crio-0de92def61e3097a1916a8923cd3ab27a2597faf6166b42144259cd4d42f90ee WatchSource:0}: Error finding container 0de92def61e3097a1916a8923cd3ab27a2597faf6166b42144259cd4d42f90ee: Status 404 returned error can't find the container with id 0de92def61e3097a1916a8923cd3ab27a2597faf6166b42144259cd4d42f90ee Jul 18 00:40:36.177341 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.177325 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-665j9" Jul 18 00:40:36.182929 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.182913 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" Jul 18 00:40:36.187306 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.187287 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67549c68_7007_460f_818e_ffecdd166d07.slice/crio-ba9c1aaa5333813464f1d64bcc4f9e666c9e962f701851e281e5788dfebb4d22 WatchSource:0}: Error finding container ba9c1aaa5333813464f1d64bcc4f9e666c9e962f701851e281e5788dfebb4d22: Status 404 returned error can't find the container with id ba9c1aaa5333813464f1d64bcc4f9e666c9e962f701851e281e5788dfebb4d22 Jul 18 00:40:36.191921 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:40:36.191901 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ad45a2_8123_4535_84bd_d327227dc6eb.slice/crio-93c04a08c1afe8e3a36c15d210b0e836432f0b7a1ae2a2fd842e6132a7473366 WatchSource:0}: Error finding container 93c04a08c1afe8e3a36c15d210b0e836432f0b7a1ae2a2fd842e6132a7473366: Status 404 returned error can't find the container with id 93c04a08c1afe8e3a36c15d210b0e836432f0b7a1ae2a2fd842e6132a7473366 Jul 18 00:40:36.399385 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.399294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:36.399385 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.399369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:36.399613 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.399505 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:36.399613 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.399595 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:37.399573075 +0000 UTC m=+3.100440081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:36.399985 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.399514 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:36.400112 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.400025 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:37.400006973 +0000 UTC m=+3.100873978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:36.500408 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.500366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:36.500600 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.500543 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:36.500600 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.500567 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:36.500600 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.500591 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:36.500783 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:36.500659 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:37.500637354 +0000 UTC m=+3.201504382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:36.730519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.729674 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:35 +0000 UTC" deadline="2028-03-22 00:55:52.950400362 +0000 UTC" Jul 18 00:40:36.730519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.729745 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14712h15m16.220659865s" Jul 18 00:40:36.736659 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.736633 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:36.737048 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.737029 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:36.859586 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.859497 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerStarted","Data":"93c04a08c1afe8e3a36c15d210b0e836432f0b7a1ae2a2fd842e6132a7473366"} Jul 18 00:40:36.886849 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.886808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-665j9" event={"ID":"67549c68-7007-460f-818e-ffecdd166d07","Type":"ContainerStarted","Data":"ba9c1aaa5333813464f1d64bcc4f9e666c9e962f701851e281e5788dfebb4d22"} Jul 18 00:40:36.913553 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.913450 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" event={"ID":"f0777511-657d-4e41-847c-1869afd0dbd3","Type":"ContainerStarted","Data":"0de92def61e3097a1916a8923cd3ab27a2597faf6166b42144259cd4d42f90ee"} Jul 18 00:40:36.917634 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.917417 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:40:36.941664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.941629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9f9bj" event={"ID":"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0","Type":"ContainerStarted","Data":"6c1bf900be67ddca9adc9b0df8ec04545653db91664194194343c3a9e20b46d1"} Jul 18 00:40:36.957418 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.957377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfb8q" event={"ID":"98a3d987-e06e-4448-83dc-4f285ec1a5c1","Type":"ContainerStarted","Data":"0697227aa11554a04b8aebfee3ac5feb17913103e7376525084f15e2e5ae4bcd"} Jul 18 00:40:36.969797 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.969752 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9k4sj" event={"ID":"130041cd-4239-4c21-b63d-2efd8ac81a49","Type":"ContainerStarted","Data":"d1f4919125aa05ec96232cbff48b3ad8fbf6df32eae90425d235d1b34bff35bb"} Jul 18 00:40:36.986880 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:36.986435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" event={"ID":"b6400620-39ec-4eaf-910a-4ffa5607175e","Type":"ContainerStarted","Data":"f5c37d4e3cd92cd24ad777f10dfa35d7ed0094934a5f8217243f12a81abe064f"} Jul 18 00:40:37.000983 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.000949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" event={"ID":"0692625a5b4ef6f547aa57e34a54c15a","Type":"ContainerStarted","Data":"40c28bcea93a409b4dbdd54dbed8831876521e1c7a9f7a0bef62e27a428c5afe"} Jul 18 00:40:37.021796 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.021758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"6e91b2e50cdadbe8bd76e913a3b275c63fc55c3bcce97b18f16e6f5ff5819903"} Jul 18 00:40:37.030366 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.030335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svr22" event={"ID":"d83e1961-e070-4cac-9e8c-e705452b0511","Type":"ContainerStarted","Data":"10d896a3f5b3c4de74fb048b70ab5b876bd168d426cd6bd1f9412f61c662653c"} Jul 18 00:40:37.042988 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.042954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" event={"ID":"29a82543545f703d857cb6e9837878f6","Type":"ContainerStarted","Data":"829cde7656153b7c35668de1614465a5832c820e68855a208b3c04e0cb743e67"} Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.418301 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.418383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.418549 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.418617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.418596067 +0000 UTC m=+5.119463082 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.419046 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:37.419219 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.419104 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.419086625 +0000 UTC m=+5.119953655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:37.520462 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.519788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:37.520462 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.520008 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:37.520462 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.520036 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:37.520462 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.520050 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:37.520462 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.520112 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:39.520093292 +0000 UTC m=+5.220960316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:37.730514 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.730416 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:35:35 +0000 UTC" deadline="2028-04-24 02:54:59.8138972 +0000 UTC" Jul 18 00:40:37.730514 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.730456 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15506h14m22.083445931s" Jul 18 00:40:37.828992 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.828958 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:37.829163 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.829137 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:37.829241 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.829188 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:37.829410 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.829349 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:37.829495 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:37.829423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:37.829548 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:37.829518 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:39.437812 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.437782 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:39.438246 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.437836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:39.438246 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.437988 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:39.438246 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.438044 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:43.438025228 +0000 UTC m=+9.138892234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:39.438489 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.438384 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:39.438489 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.438440 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:43.438424277 +0000 UTC m=+9.139291291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:39.538923 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.538377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:39.538923 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.538519 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:39.538923 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.538541 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:39.538923 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.538554 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:39.538923 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.538606 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:43.538588788 +0000 UTC m=+9.239455785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:39.828914 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.828834 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:39.828914 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.828873 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:39.829138 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.828976 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:39.829138 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.829079 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:39.829138 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:39.829115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:39.829285 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:39.829179 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:41.829113 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:41.829076 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:41.829629 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:41.829119 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:41.829629 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:41.829183 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:41.829629 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:41.829328 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:41.829629 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:41.829365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:41.829629 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:41.829452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:43.469170 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.469126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:43.469674 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.469231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:43.469674 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.469257 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:43.469674 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.469356 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:51.469334419 +0000 UTC m=+17.170201419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:43.469674 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.469355 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:43.469674 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.469387 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:40:51.46938042 +0000 UTC m=+17.170247417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:43.569968 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.569930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:43.570155 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.570123 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:43.570155 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.570145 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:43.570271 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.570157 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:43.570271 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.570212 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:40:51.570195257 +0000 UTC m=+17.271062270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:43.829099 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.828799 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:43.829099 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.828936 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:43.829341 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.829268 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:43.829401 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.829377 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:43.829455 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:43.829427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:43.829511 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:43.829495 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:45.829651 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:45.829571 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:45.829651 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:45.829594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:45.830126 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:45.829581 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:45.830126 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:45.829720 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:45.830126 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:45.829788 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:45.830126 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:45.829876 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:47.829512 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:47.829480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:47.829843 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:47.829584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:47.829843 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:47.829480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:47.829843 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:47.829663 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:47.829843 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:47.829480 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:47.829843 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:47.829720 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:49.828855 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:49.828823 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:49.829319 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:49.828875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:49.829319 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:49.828930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:49.829319 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:49.828956 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:49.829319 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:49.829048 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:49.829319 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:49.829117 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:51.527850 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.527808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:51.528365 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.527859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:51.528365 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.527966 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:51.528365 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.527982 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:51.528365 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.528053 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:07.528029876 +0000 UTC m=+33.228896898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:40:51.528365 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.528075 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:07.528064336 +0000 UTC m=+33.228931333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:40:51.628336 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.628291 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:51.628502 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.628450 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:40:51.628502 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.628472 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:40:51.628502 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.628487 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:51.628598 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.628547 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:07.628533752 +0000 UTC m=+33.329400753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:40:51.829089 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.829021 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:51.829227 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.829029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:51.829227 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.829147 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:51.829227 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:51.829035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:51.829383 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.829229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:51.829383 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:51.829323 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:53.828723 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:53.828689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:53.829187 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:53.828689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:53.829187 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:53.828809 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:53.829187 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:53.828689 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:53.829187 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:53.828887 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:53.829187 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:53.828998 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:55.828780 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:55.828743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:55.828780 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:55.828779 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:55.829285 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:55.828841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:55.829285 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:55.828855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:55.829285 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:55.828926 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:55.829285 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:55.828994 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:57.110140 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.109774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" event={"ID":"f0777511-657d-4e41-847c-1869afd0dbd3","Type":"ContainerStarted","Data":"ea750fb15f2941840a08091e5dc499133a8ba896a853653876dcd9e932b8c550"} Jul 18 00:40:57.113880 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.113854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfb8q" event={"ID":"98a3d987-e06e-4448-83dc-4f285ec1a5c1","Type":"ContainerStarted","Data":"176b80378765cc01efeb5ae688e2d13108d8088534433c9a22c7445807e520af"} Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117022 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117492 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c6778b5-044f-4a9b-bd04-c8980a63e6be" containerID="4c9bf1608a3056d2710243de4ac41697e47cf585b1e286504480a3562fb661a5" exitCode=1 Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"0526e3a832559d3521af2cb8f2dfd6aa7d29fe6667872b368fdc7f9e0d07a4c6"} Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"4d1e79965421e9c001382ed2dcd75636e18c3c23f668beb060f160a8bfc5ddce"} Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"52095cb059aa8bf7ee58ee5a56a21690ee2be373d5c829c691bd28333929a6f0"} Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117836 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerDied","Data":"4c9bf1608a3056d2710243de4ac41697e47cf585b1e286504480a3562fb661a5"} Jul 18 00:40:57.118799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.117900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"2df12de6e73e4fc7d490730f024f93096a844e2f1747276267bc72c3c581a3d1"} Jul 18 00:40:57.120051 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.120028 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" event={"ID":"29a82543545f703d857cb6e9837878f6","Type":"ContainerStarted","Data":"c144ff9ff146f65b30da8f53cef7098806a7e5dd9b382c47b18c56aad70fd9c0"} Jul 18 00:40:57.129878 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.129843 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8qvrc" podStartSLOduration=1.951918424 podStartE2EDuration="22.129829928s" totalImagesPullingTime="20.177911504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:57.12946588 +0000 UTC m=+22.830332898" watchObservedRunningTime="2026-07-18 00:40:57.129829928 +0000 UTC m=+22.830696947" Jul 18 00:40:57.143826 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.143786 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-15.ec2.internal" podStartSLOduration=22.14377344 podStartE2EDuration="22.14377344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:57.143528493 +0000 UTC m=+22.844395515" watchObservedRunningTime="2026-07-18 00:40:57.14377344 +0000 UTC m=+22.844640459" Jul 18 00:40:57.158594 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.158517 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bfb8q" podStartSLOduration=1.903089236 podStartE2EDuration="22.158503493s" totalImagesPullingTime="20.255414257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:57.158051955 +0000 UTC m=+22.858918974" watchObservedRunningTime="2026-07-18 00:40:57.158503493 +0000 UTC m=+22.859370512" Jul 18 00:40:57.829660 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.829374 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:57.829866 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.829375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:57.829866 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:57.829725 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:57.829866 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:57.829376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:57.829866 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:57.829815 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:57.829866 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:57.829855 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:40:58.123921 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.123821 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="e3405c1f9c1e8dc1c7044780eb223d79a5c6b3271dba21cc69188fa3a8f633f6" exitCode=0 Jul 18 00:40:58.123921 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.123862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"e3405c1f9c1e8dc1c7044780eb223d79a5c6b3271dba21cc69188fa3a8f633f6"} Jul 18 00:40:58.125432 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.125416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-665j9" event={"ID":"67549c68-7007-460f-818e-ffecdd166d07","Type":"ContainerStarted","Data":"dc247524195f07f2cee2f3dfd5928f41e0732f6da3085d09f87f607efa5e6936"} Jul 18 00:40:58.126809 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.126791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9f9bj" event={"ID":"1ac0a18d-fe84-40d6-8d10-52ac3886b0a0","Type":"ContainerStarted","Data":"4f51be8af1ebe072159450022247b026ebebc4b7982f49869f8b916caa5815ee"} Jul 18 00:40:58.128230 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.128209 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9k4sj" event={"ID":"130041cd-4239-4c21-b63d-2efd8ac81a49","Type":"ContainerStarted","Data":"22683d735f2598c2063e1f7fd1d7e143be1300838a8b57f53daeb12185518afd"} Jul 18 00:40:58.129607 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.129579 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" event={"ID":"b6400620-39ec-4eaf-910a-4ffa5607175e","Type":"ContainerStarted","Data":"6fa0d451b261b504ca885391e87189dcdafb440c46ace64a0507a8a6b9a3abeb"} Jul 18 00:40:58.130936 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.130917 2581 generic.go:356] "Generic (PLEG): container finished" podID="0692625a5b4ef6f547aa57e34a54c15a" containerID="ffdc21cc0cd3cd7c2bbce5753257ac36d9565318cd52afeee9f978c4525cb5ea" exitCode=0 Jul 18 00:40:58.131019 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.130978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" event={"ID":"0692625a5b4ef6f547aa57e34a54c15a","Type":"ContainerDied","Data":"ffdc21cc0cd3cd7c2bbce5753257ac36d9565318cd52afeee9f978c4525cb5ea"} Jul 18 00:40:58.133650 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.133633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:40:58.134018 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.134002 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"c6c69da51adaee19637746be78aeedfe3f5669af694fb1a508982b596824af2d"} Jul 18 00:40:58.135259 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.135238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-svr22" event={"ID":"d83e1961-e070-4cac-9e8c-e705452b0511","Type":"ContainerStarted","Data":"4f98da0598da40ceaca398293bd1cfa52430ea1abd43b5419fa410fed26534f2"} Jul 18 00:40:58.155574 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.155540 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9f9bj" podStartSLOduration=2.9466200750000002 podStartE2EDuration="23.155528167s" totalImagesPullingTime="20.208908092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:58.155326812 +0000 UTC m=+23.856193850" watchObservedRunningTime="2026-07-18 00:40:58.155528167 +0000 UTC m=+23.856395186" Jul 18 00:40:58.167859 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.167826 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9k4sj" podStartSLOduration=2.914360431 podStartE2EDuration="23.167814497s" totalImagesPullingTime="20.253454066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:58.167595657 +0000 UTC m=+23.868462677" watchObservedRunningTime="2026-07-18 00:40:58.167814497 +0000 UTC m=+23.868681515" Jul 18 00:40:58.184494 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.184445 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-665j9" podStartSLOduration=3.053284008 podStartE2EDuration="23.184427679s" totalImagesPullingTime="20.131143671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:58.184369094 +0000 UTC m=+23.885236135" watchObservedRunningTime="2026-07-18 00:40:58.184427679 +0000 UTC m=+23.885294698" Jul 18 00:40:58.210758 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.210708 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-svr22" podStartSLOduration=2.920198515 podStartE2EDuration="23.210693441s" totalImagesPullingTime="20.290494926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:58.210605741 +0000 UTC m=+23.911472779" watchObservedRunningTime="2026-07-18 00:40:58.210693441 +0000 UTC m=+23.911560461" Jul 18 00:40:58.313973 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.313939 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:58.314568 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.314553 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:58.538153 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.538124 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 00:40:58.750945 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.750754 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:40:58.538143104Z","UUID":"a68c199d-e37d-40ce-a73e-5778cac62613","Handler":null,"Name":"","Endpoint":""} Jul 18 00:40:58.752652 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.752631 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 00:40:58.752782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:58.752673 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 00:40:59.139840 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.139760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" event={"ID":"b6400620-39ec-4eaf-910a-4ffa5607175e","Type":"ContainerStarted","Data":"d6605d98cce806d8ca69fb4144c2cfaa73700b855e9e4eaf3e977433f0a2e69d"} Jul 18 00:40:59.142210 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.142177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" event={"ID":"0692625a5b4ef6f547aa57e34a54c15a","Type":"ContainerStarted","Data":"db0e7e2fab98085e0ec9351533df1c28bde995c119aae5eda453f490dca52ab0"} Jul 18 00:40:59.142501 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.142482 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:59.143535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.143514 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-svr22" Jul 18 00:40:59.157363 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.157298 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-15.ec2.internal" podStartSLOduration=24.157277067 podStartE2EDuration="24.157277067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:40:59.15635314 +0000 UTC m=+24.857220184" watchObservedRunningTime="2026-07-18 00:40:59.157277067 +0000 UTC m=+24.858144087" Jul 18 00:40:59.828709 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.828684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:40:59.828849 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.828687 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:40:59.828849 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:59.828807 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:40:59.828849 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:40:59.828819 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:40:59.829022 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:59.828934 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:40:59.829086 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:40:59.829071 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:00.147117 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:00.146984 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" event={"ID":"b6400620-39ec-4eaf-910a-4ffa5607175e","Type":"ContainerStarted","Data":"95cd93d8f87610b5aad9bbfa9948c3b668ceb5189cadf2f77bd671d57ee4b0d0"} Jul 18 00:41:00.153114 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:00.153085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:41:00.153587 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:00.153558 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"6887124e2de7b03acb22c051712f05bf0f7aa81ee579e40e01fe3ae8d67f58b8"} Jul 18 00:41:00.164144 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:00.164090 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ml2fp" podStartSLOduration=2.5391708250000002 podStartE2EDuration="25.164072548s" totalImagesPullingTime="22.624901723s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:00.163539665 +0000 UTC m=+25.864406684" watchObservedRunningTime="2026-07-18 00:41:00.164072548 +0000 UTC m=+25.864939568" Jul 18 00:41:01.829399 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:01.829365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:01.829399 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:01.829385 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:01.829937 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:01.829376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:01.829937 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:01.829493 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:41:01.829937 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:01.829585 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:01.829937 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:01.829661 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:41:02.163908 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.163496 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:41:02.164553 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.164180 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"aa94b0ce27e9937fa1b08263ccbd63b803dcf15be584063356ab99b4a976c52b"} Jul 18 00:41:02.164553 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.164532 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:02.164736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.164616 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:02.164736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.164667 2581 scope.go:117] "RemoveContainer" containerID="4c9bf1608a3056d2710243de4ac41697e47cf585b1e286504480a3562fb661a5" Jul 18 00:41:02.181195 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:02.181165 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:03.168007 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.167970 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="dafdb4800dc76f22d52e38d8d703f22f8363eec96147aa919bec4d39083d5d2f" exitCode=0 Jul 18 00:41:03.168925 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.168051 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"dafdb4800dc76f22d52e38d8d703f22f8363eec96147aa919bec4d39083d5d2f"} Jul 18 00:41:03.171936 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.171921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:41:03.172299 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.172250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" event={"ID":"4c6778b5-044f-4a9b-bd04-c8980a63e6be","Type":"ContainerStarted","Data":"522cacd2f206255b9a84532f089e81ad5234dfb4ba38746a17ccc6d420265ce7"} Jul 18 00:41:03.172610 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.172594 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:03.187590 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.187572 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:03.213380 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.213334 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" podStartSLOduration=7.824012112 podStartE2EDuration="28.213320314s" totalImagesPullingTime="20.389308202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:03.211763058 +0000 UTC m=+28.912630077" watchObservedRunningTime="2026-07-18 00:41:03.213320314 +0000 UTC m=+28.914187324" Jul 18 00:41:03.828951 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.828745 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:03.829105 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.828745 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:03.829105 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:03.829053 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:03.829207 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:03.828745 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:03.829207 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:03.829161 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:41:03.829302 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:03.829229 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:41:04.052077 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.052047 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r4jbh"] Jul 18 00:41:04.055136 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.055091 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qvbq"] Jul 18 00:41:04.055903 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.055877 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vk48"] Jul 18 00:41:04.176558 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.176540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:04.176928 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.176584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerStarted","Data":"b0cfc7c4f34ec282351c3642744051b1c1c19c55a235780b0a7dc2729db1fa93"} Jul 18 00:41:04.176928 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.176638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:04.176928 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:04.176666 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:41:04.176928 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:04.176700 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:04.176928 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:04.176870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:04.177194 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:04.176972 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:41:05.180225 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:05.180190 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="b0cfc7c4f34ec282351c3642744051b1c1c19c55a235780b0a7dc2729db1fa93" exitCode=0 Jul 18 00:41:05.180624 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:05.180275 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"b0cfc7c4f34ec282351c3642744051b1c1c19c55a235780b0a7dc2729db1fa93"} Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:05.829040 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:05.829169 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:05.829257 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:05.829359 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:05.829430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:05.829558 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:05.829520 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:41:07.187806 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.187607 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="b0e781c57dd4eaeb1ce867beee73bb73b6b550c8865928bcec0ec35e172da268" exitCode=0 Jul 18 00:41:07.188203 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.187694 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"b0e781c57dd4eaeb1ce867beee73bb73b6b550c8865928bcec0ec35e172da268"} Jul 18 00:41:07.552692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.552607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:07.552692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.552650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:07.552864 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.552757 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:41:07.552864 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.552810 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:39.552795752 +0000 UTC m=+65.253662749 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:41:07.552864 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.552757 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:41:07.552973 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.552880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret podName:5861b829-9730-49e3-9359-db5f78ffe35c nodeName:}" failed. No retries permitted until 2026-07-18 00:41:39.55286763 +0000 UTC m=+65.253734642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret") pod "global-pull-secret-syncer-r4jbh" (UID: "5861b829-9730-49e3-9359-db5f78ffe35c") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:41:07.653473 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.653441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:07.653621 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.653569 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:41:07.653621 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.653583 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:41:07.653621 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.653593 2581 projected.go:196] Error preparing data for projected volume kube-api-access-z7c99 for pod openshift-network-diagnostics/network-check-target-7qvbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:41:07.653728 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.653642 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99 podName:9fa91723-47de-4f00-9daf-66e300e23e17 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:39.65362572 +0000 UTC m=+65.354492733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z7c99" (UniqueName: "kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99") pod "network-check-target-7qvbq" (UID: "9fa91723-47de-4f00-9daf-66e300e23e17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:41:07.829487 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.829408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:07.829654 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.829408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:07.829654 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.829544 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r4jbh" podUID="5861b829-9730-49e3-9359-db5f78ffe35c" Jul 18 00:41:07.829654 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:07.829408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:07.829654 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.829644 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qvbq" podUID="9fa91723-47de-4f00-9daf-66e300e23e17" Jul 18 00:41:07.829797 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:07.829746 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:41:09.618018 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.617986 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-15.ec2.internal" event="NodeReady" Jul 18 00:41:09.618451 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.618105 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 00:41:09.657975 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.657942 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nj665"] Jul 18 00:41:09.675292 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.675266 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wwgh8"] Jul 18 00:41:09.675454 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.675415 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.677664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.677489 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 00:41:09.677664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.677569 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\"" Jul 18 00:41:09.677664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.677591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 00:41:09.697635 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.697614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nj665"] Jul 18 00:41:09.697750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.697651 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wwgh8"] Jul 18 00:41:09.697750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.697742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.699842 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.699802 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 00:41:09.699842 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.699840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 00:41:09.700007 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.699845 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 00:41:09.700007 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.699877 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jgd\"" Jul 18 00:41:09.769394 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.769363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wv4d\" (UniqueName: \"kubernetes.io/projected/da02bdd2-5e15-45aa-89cf-172b7ef7b342-kube-api-access-2wv4d\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.769564 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.769416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da02bdd2-5e15-45aa-89cf-172b7ef7b342-config-volume\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.769564 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.769551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.769664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.769586 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da02bdd2-5e15-45aa-89cf-172b7ef7b342-tmp-dir\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.829620 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.829583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:09.829792 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.829600 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:09.829792 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.829605 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:09.832363 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832343 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:41:09.832586 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832564 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:41:09.832704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832600 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:41:09.832704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832620 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\"" Jul 18 00:41:09.832704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832646 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\"" Jul 18 00:41:09.832909 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.832892 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:41:09.870198 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870137 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpnn\" (UniqueName: \"kubernetes.io/projected/0c76e302-fce9-4b64-96d0-15c3ee3573ab-kube-api-access-kkpnn\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.870198 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870212 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da02bdd2-5e15-45aa-89cf-172b7ef7b342-tmp-dir\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c76e302-fce9-4b64-96d0-15c3ee3573ab-cert\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wv4d\" (UniqueName: \"kubernetes.io/projected/da02bdd2-5e15-45aa-89cf-172b7ef7b342-kube-api-access-2wv4d\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:09.870320 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870335 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da02bdd2-5e15-45aa-89cf-172b7ef7b342-config-volume\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.870405 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:09.870384 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:10.370363062 +0000 UTC m=+36.071230063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:09.870681 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da02bdd2-5e15-45aa-89cf-172b7ef7b342-tmp-dir\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.870915 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.870895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da02bdd2-5e15-45aa-89cf-172b7ef7b342-config-volume\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.880794 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.880771 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wv4d\" (UniqueName: \"kubernetes.io/projected/da02bdd2-5e15-45aa-89cf-172b7ef7b342-kube-api-access-2wv4d\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:09.971779 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.971745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpnn\" (UniqueName: \"kubernetes.io/projected/0c76e302-fce9-4b64-96d0-15c3ee3573ab-kube-api-access-kkpnn\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.971969 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.971808 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c76e302-fce9-4b64-96d0-15c3ee3573ab-cert\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.974523 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.974496 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c76e302-fce9-4b64-96d0-15c3ee3573ab-cert\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:09.981285 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:09.981258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpnn\" (UniqueName: \"kubernetes.io/projected/0c76e302-fce9-4b64-96d0-15c3ee3573ab-kube-api-access-kkpnn\") pod \"ingress-canary-wwgh8\" (UID: \"0c76e302-fce9-4b64-96d0-15c3ee3573ab\") " pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:10.008353 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:10.008321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wwgh8" Jul 18 00:41:10.375738 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:10.375697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:10.375931 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:10.375875 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:10.375989 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:10.375949 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:11.375930541 +0000 UTC m=+37.076797539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:11.384249 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:11.384213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:11.384871 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:11.384354 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:11.384871 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:11.384417 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:13.384398549 +0000 UTC m=+39.085265557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:11.402118 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:11.401952 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wwgh8"] Jul 18 00:41:11.432106 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:41:11.432078 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c76e302_fce9_4b64_96d0_15c3ee3573ab.slice/crio-d6d05518e4c4b9ce39a4344b950c5ded47f56fe3c61ecfb07ee0eda9a7b61106 WatchSource:0}: Error finding container d6d05518e4c4b9ce39a4344b950c5ded47f56fe3c61ecfb07ee0eda9a7b61106: Status 404 returned error can't find the container with id d6d05518e4c4b9ce39a4344b950c5ded47f56fe3c61ecfb07ee0eda9a7b61106 Jul 18 00:41:12.201537 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:12.201502 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wwgh8" event={"ID":"0c76e302-fce9-4b64-96d0-15c3ee3573ab","Type":"ContainerStarted","Data":"d6d05518e4c4b9ce39a4344b950c5ded47f56fe3c61ecfb07ee0eda9a7b61106"} Jul 18 00:41:12.205230 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:12.205202 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="dadec3ef570de7c41826443b7a567ddd5069aff6d8f189977d25062de06eefd9" exitCode=0 Jul 18 00:41:12.205395 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:12.205253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"dadec3ef570de7c41826443b7a567ddd5069aff6d8f189977d25062de06eefd9"} Jul 18 00:41:13.211587 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:13.211538 2581 generic.go:356] "Generic (PLEG): container finished" podID="d3ad45a2-8123-4535-84bd-d327227dc6eb" containerID="a73394589dea14e9c44226718a61e4fe87711d3dca57b74fc7be2c6ae8e4943f" exitCode=0 Jul 18 00:41:13.212068 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:13.211620 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerDied","Data":"a73394589dea14e9c44226718a61e4fe87711d3dca57b74fc7be2c6ae8e4943f"} Jul 18 00:41:13.399267 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:13.399133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:13.399465 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:13.399328 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:13.399465 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:13.399404 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:17.399380416 +0000 UTC m=+43.100247418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:14.218750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:14.218651 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" event={"ID":"d3ad45a2-8123-4535-84bd-d327227dc6eb","Type":"ContainerStarted","Data":"94d533fe5ae6c8ee417f70e1408a9722dd1f08d5d62f4b39ca5c89c2975ce87d"} Jul 18 00:41:14.220287 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:14.220262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wwgh8" event={"ID":"0c76e302-fce9-4b64-96d0-15c3ee3573ab","Type":"ContainerStarted","Data":"92e1652ce8fa0a4db011b7f0e4d20ab88dd33d00d80263168448fa2469302521"} Jul 18 00:41:14.239174 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:14.239123 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5nbk2" podStartSLOduration=8.951809929 podStartE2EDuration="39.239107469s" totalImagesPullingTime="30.28729754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:14.237540829 +0000 UTC m=+39.938407849" watchObservedRunningTime="2026-07-18 00:41:14.239107469 +0000 UTC m=+39.939974487" Jul 18 00:41:14.250892 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:14.250843 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wwgh8" podStartSLOduration=2.725167324 podStartE2EDuration="5.250824164s" totalImagesPullingTime="2.52565684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:14.250202326 +0000 UTC m=+39.951069374" watchObservedRunningTime="2026-07-18 00:41:14.250824164 +0000 UTC m=+39.951691183" Jul 18 00:41:17.429722 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:17.429529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:17.430192 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:17.429677 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:17.430192 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:17.429878 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:25.429852485 +0000 UTC m=+51.130719496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:25.485578 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:25.485523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:25.486053 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:25.485666 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:25.486053 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:25.485730 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:41:41.485714593 +0000 UTC m=+67.186581592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:31.285962 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.285930 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj"] Jul 18 00:41:31.307449 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.307425 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx"] Jul 18 00:41:31.307579 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.307546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.309849 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.309826 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 18 00:41:31.309970 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.309932 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 18 00:41:31.310030 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.309991 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 18 00:41:31.310030 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.310007 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 18 00:41:31.322779 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.322760 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj"] Jul 18 00:41:31.322870 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.322808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx"] Jul 18 00:41:31.322910 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.322877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.325230 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d179ab8-0e0a-449b-abea-068fccd69b06-klusterlet-config\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.325367 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htdz4\" (UniqueName: \"kubernetes.io/projected/3d179ab8-0e0a-449b-abea-068fccd69b06-kube-api-access-htdz4\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.325367 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d179ab8-0e0a-449b-abea-068fccd69b06-tmp\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.325839 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325818 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 18 00:41:31.325954 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325860 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 18 00:41:31.325954 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.325863 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 18 00:41:31.326180 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.326154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 18 00:41:31.427723 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d179ab8-0e0a-449b-abea-068fccd69b06-tmp\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.427723 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.427943 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427751 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22412daa-61d7-48e9-a690-a90fe3e3d66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.427943 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427772 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhc8l\" (UniqueName: \"kubernetes.io/projected/22412daa-61d7-48e9-a690-a90fe3e3d66e-kube-api-access-nhc8l\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.427943 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.427943 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.428131 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d179ab8-0e0a-449b-abea-068fccd69b06-klusterlet-config\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.428131 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.427984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htdz4\" (UniqueName: \"kubernetes.io/projected/3d179ab8-0e0a-449b-abea-068fccd69b06-kube-api-access-htdz4\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.428131 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.428011 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.428131 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.428047 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d179ab8-0e0a-449b-abea-068fccd69b06-tmp\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.432016 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.431995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3d179ab8-0e0a-449b-abea-068fccd69b06-klusterlet-config\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.435675 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.435655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htdz4\" (UniqueName: \"kubernetes.io/projected/3d179ab8-0e0a-449b-abea-068fccd69b06-kube-api-access-htdz4\") pod \"klusterlet-addon-workmgr-c79c96766-mlmgj\" (UID: \"3d179ab8-0e0a-449b-abea-068fccd69b06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.529096 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22412daa-61d7-48e9-a690-a90fe3e3d66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhc8l\" (UniqueName: \"kubernetes.io/projected/22412daa-61d7-48e9-a690-a90fe3e3d66e-kube-api-access-nhc8l\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529465 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.529968 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.529941 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/22412daa-61d7-48e9-a690-a90fe3e3d66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.531789 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.531762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-ca\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.531883 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.531820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.531883 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.531844 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.531883 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.531868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22412daa-61d7-48e9-a690-a90fe3e3d66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.536657 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.536603 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhc8l\" (UniqueName: \"kubernetes.io/projected/22412daa-61d7-48e9-a690-a90fe3e3d66e-kube-api-access-nhc8l\") pod \"cluster-proxy-proxy-agent-6b8f8854cf-jttsx\" (UID: \"22412daa-61d7-48e9-a690-a90fe3e3d66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.616695 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.616658 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:31.645840 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.645811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:41:31.766219 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.766194 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj"] Jul 18 00:41:31.769198 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:41:31.769164 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d179ab8_0e0a_449b_abea_068fccd69b06.slice/crio-6e7db85dece5329598b52627db4dd89db34500ce46b93e3e521f8573d62f9a55 WatchSource:0}: Error finding container 6e7db85dece5329598b52627db4dd89db34500ce46b93e3e521f8573d62f9a55: Status 404 returned error can't find the container with id 6e7db85dece5329598b52627db4dd89db34500ce46b93e3e521f8573d62f9a55 Jul 18 00:41:31.790856 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:31.790798 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx"] Jul 18 00:41:31.793444 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:41:31.793417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22412daa_61d7_48e9_a690_a90fe3e3d66e.slice/crio-d3a5c006997624a83ce517c2c94182a7ea4a1bddb18d050f62c48d803068f21b WatchSource:0}: Error finding container d3a5c006997624a83ce517c2c94182a7ea4a1bddb18d050f62c48d803068f21b: Status 404 returned error can't find the container with id d3a5c006997624a83ce517c2c94182a7ea4a1bddb18d050f62c48d803068f21b Jul 18 00:41:32.264845 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:32.264807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerStarted","Data":"d3a5c006997624a83ce517c2c94182a7ea4a1bddb18d050f62c48d803068f21b"} Jul 18 00:41:32.265865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:32.265842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" event={"ID":"3d179ab8-0e0a-449b-abea-068fccd69b06","Type":"ContainerStarted","Data":"6e7db85dece5329598b52627db4dd89db34500ce46b93e3e521f8573d62f9a55"} Jul 18 00:41:35.191191 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:35.191161 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qt8nd" Jul 18 00:41:37.284706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.284665 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerStarted","Data":"8f894a103f83df1b53e257c99c340a9942ce38aab8b1afad6ca805aad5cf8465"} Jul 18 00:41:37.284706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.284708 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerStarted","Data":"7a647152eb433f2124fa4155f0580a8f06704bc8dde5bc6b657b7d4708e52419"} Jul 18 00:41:37.285201 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.284720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerStarted","Data":"d0c1632ab81ee91ee3fef57c9f9d14e5de75c4b3f9fb249a7d6f33a14a3a1981"} Jul 18 00:41:37.286178 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.286153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" event={"ID":"3d179ab8-0e0a-449b-abea-068fccd69b06","Type":"ContainerStarted","Data":"18eee52c5578f6b6f4a54fde52fa1831f6f2587c5ad80c7b29450e8f53eb8469"} Jul 18 00:41:37.286319 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.286231 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:37.287861 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.287842 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:41:37.302690 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.302641 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" podStartSLOduration=1.330877498 podStartE2EDuration="6.302628935s" totalImagesPullingTime="4.971751437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:37.301978317 +0000 UTC m=+63.002845367" watchObservedRunningTime="2026-07-18 00:41:37.302628935 +0000 UTC m=+63.003495954" Jul 18 00:41:37.320173 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:37.320129 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" podStartSLOduration=1.3244618 podStartE2EDuration="6.320115812s" totalImagesPullingTime="4.995654012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:37.319235103 +0000 UTC m=+63.020102123" watchObservedRunningTime="2026-07-18 00:41:37.320115812 +0000 UTC m=+63.020982830" Jul 18 00:41:39.591174 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.591130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:39.591174 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.591177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:41:39.593514 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.593492 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:41:39.593746 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.593733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:41:39.601516 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:39.601498 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 00:41:39.601588 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:39.601576 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:42:43.601556733 +0000 UTC m=+129.302423748 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : secret "metrics-daemon-secret" not found Jul 18 00:41:39.603666 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.603649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5861b829-9730-49e3-9359-db5f78ffe35c-original-pull-secret\") pod \"global-pull-secret-syncer-r4jbh\" (UID: \"5861b829-9730-49e3-9359-db5f78ffe35c\") " pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:39.691836 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.691803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:39.694185 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.694168 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:41:39.704980 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.704961 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:41:39.715629 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.715604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7c99\" (UniqueName: \"kubernetes.io/projected/9fa91723-47de-4f00-9daf-66e300e23e17-kube-api-access-z7c99\") pod \"network-check-target-7qvbq\" (UID: \"9fa91723-47de-4f00-9daf-66e300e23e17\") " pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:39.850197 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.850120 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zwmmq\"" Jul 18 00:41:39.853891 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.853877 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r4jbh" Jul 18 00:41:39.858231 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:39.858217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:40.001521 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:40.001490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qvbq"] Jul 18 00:41:40.005599 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:41:40.005576 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa91723_47de_4f00_9daf_66e300e23e17.slice/crio-5ce452eb9bcf8fa525f3422f12f1cdc805605d7d1960f3a0695727009400c558 WatchSource:0}: Error finding container 5ce452eb9bcf8fa525f3422f12f1cdc805605d7d1960f3a0695727009400c558: Status 404 returned error can't find the container with id 5ce452eb9bcf8fa525f3422f12f1cdc805605d7d1960f3a0695727009400c558 Jul 18 00:41:40.017937 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:40.017913 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r4jbh"] Jul 18 00:41:40.020684 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:41:40.020662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5861b829_9730_49e3_9359_db5f78ffe35c.slice/crio-91b93ea5d970233afe164a10caa91cefb03a0eeda5b8b2848515a8557d4e6ee8 WatchSource:0}: Error finding container 91b93ea5d970233afe164a10caa91cefb03a0eeda5b8b2848515a8557d4e6ee8: Status 404 returned error can't find the container with id 91b93ea5d970233afe164a10caa91cefb03a0eeda5b8b2848515a8557d4e6ee8 Jul 18 00:41:40.294238 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:40.294199 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r4jbh" event={"ID":"5861b829-9730-49e3-9359-db5f78ffe35c","Type":"ContainerStarted","Data":"91b93ea5d970233afe164a10caa91cefb03a0eeda5b8b2848515a8557d4e6ee8"} Jul 18 00:41:40.295164 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:40.295143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qvbq" event={"ID":"9fa91723-47de-4f00-9daf-66e300e23e17","Type":"ContainerStarted","Data":"5ce452eb9bcf8fa525f3422f12f1cdc805605d7d1960f3a0695727009400c558"} Jul 18 00:41:41.505612 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:41.505513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:41:41.506116 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:41.505730 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:41:41.506116 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:41:41.505812 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:42:13.505789805 +0000 UTC m=+99.206656807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:41:45.311757 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:45.311725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qvbq" event={"ID":"9fa91723-47de-4f00-9daf-66e300e23e17","Type":"ContainerStarted","Data":"6127c76fb6a6cc28c46f673fc231de6a90d1058304b90f8117570cd1d251b706"} Jul 18 00:41:45.312289 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:45.311805 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:41:45.313172 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:45.313147 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r4jbh" event={"ID":"5861b829-9730-49e3-9359-db5f78ffe35c","Type":"ContainerStarted","Data":"5c761aad6e3597acd03cb85b54a606ffbe8c631dd76a24ab6c6be978ad20d51b"} Jul 18 00:41:45.329538 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:45.327469 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7qvbq" podStartSLOduration=65.76128116 podStartE2EDuration="1m10.327449761s" totalImagesPullingTime="4.566168601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:45.325755537 +0000 UTC m=+71.026622573" watchObservedRunningTime="2026-07-18 00:41:45.327449761 +0000 UTC m=+71.028316781" Jul 18 00:41:45.341113 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:41:45.341073 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r4jbh" podStartSLOduration=65.779186111 podStartE2EDuration="1m10.34106219s" totalImagesPullingTime="4.561876079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:41:45.340567868 +0000 UTC m=+71.041434892" watchObservedRunningTime="2026-07-18 00:41:45.34106219 +0000 UTC m=+71.041929208" Jul 18 00:42:13.521004 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:42:13.520952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:42:13.521516 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:42:13.521111 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:42:13.521516 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:42:13.521178 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:43:17.521161231 +0000 UTC m=+163.222028228 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:42:16.318671 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:42:16.318639 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7qvbq" Jul 18 00:42:43.626346 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:42:43.626271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:42:43.626839 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:42:43.626433 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 18 00:42:43.626839 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:42:43.626497 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs podName:b06a33fa-efd3-4a44-a5aa-c12c794d26c4 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:45.62648265 +0000 UTC m=+251.327349648 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs") pod "network-metrics-daemon-7vk48" (UID: "b06a33fa-efd3-4a44-a5aa-c12c794d26c4") : secret "metrics-daemon-secret" not found Jul 18 00:43:12.685150 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:43:12.685096 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nj665" podUID="da02bdd2-5e15-45aa-89cf-172b7ef7b342" Jul 18 00:43:12.841328 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:43:12.841277 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7vk48" podUID="b06a33fa-efd3-4a44-a5aa-c12c794d26c4" Jul 18 00:43:13.556419 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:13.556383 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj665" Jul 18 00:43:17.557721 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:17.557685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:43:17.558126 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:43:17.557811 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 18 00:43:17.558126 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:43:17.557886 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls podName:da02bdd2-5e15-45aa-89cf-172b7ef7b342 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:19.557868378 +0000 UTC m=+285.258735376 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls") pod "dns-default-nj665" (UID: "da02bdd2-5e15-45aa-89cf-172b7ef7b342") : secret "dns-default-metrics-tls" not found Jul 18 00:43:23.828874 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:23.828838 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:43:37.287130 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:37.287079 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" podUID="3d179ab8-0e0a-449b-abea-068fccd69b06" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jul 18 00:43:37.624656 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:37.624576 2581 generic.go:356] "Generic (PLEG): container finished" podID="3d179ab8-0e0a-449b-abea-068fccd69b06" containerID="18eee52c5578f6b6f4a54fde52fa1831f6f2587c5ad80c7b29450e8f53eb8469" exitCode=1 Jul 18 00:43:37.624656 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:37.624622 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" event={"ID":"3d179ab8-0e0a-449b-abea-068fccd69b06","Type":"ContainerDied","Data":"18eee52c5578f6b6f4a54fde52fa1831f6f2587c5ad80c7b29450e8f53eb8469"} Jul 18 00:43:37.624959 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:37.624943 2581 scope.go:117] "RemoveContainer" containerID="18eee52c5578f6b6f4a54fde52fa1831f6f2587c5ad80c7b29450e8f53eb8469" Jul 18 00:43:38.628713 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:38.628682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" event={"ID":"3d179ab8-0e0a-449b-abea-068fccd69b06","Type":"ContainerStarted","Data":"6468e1139f2b60d4a24701c0a1e096bb3648966c1446842ea234fcc545335b34"} Jul 18 00:43:38.629105 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:38.628954 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:43:38.629532 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:43:38.629511 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c79c96766-mlmgj" Jul 18 00:44:22.728484 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.728448 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mcpwb"] Jul 18 00:44:22.730607 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.730587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.732888 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.732869 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 00:44:22.732974 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.732915 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56l9r\"" Jul 18 00:44:22.733891 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.733873 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 00:44:22.734166 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.734148 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 00:44:22.734290 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.734273 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 00:44:22.739435 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.739416 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcpwb"] Jul 18 00:44:22.799071 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.799036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.799226 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.799074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.799226 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.799106 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b844f20-67a5-4eb9-a016-0a37fd526693-crio-socket\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.799226 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.799163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b844f20-67a5-4eb9-a016-0a37fd526693-data-volume\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.799226 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.799190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27gc\" (UniqueName: \"kubernetes.io/projected/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-api-access-q27gc\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899481 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899447 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b844f20-67a5-4eb9-a016-0a37fd526693-data-volume\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899625 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q27gc\" (UniqueName: \"kubernetes.io/projected/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-api-access-q27gc\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899625 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899625 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b844f20-67a5-4eb9-a016-0a37fd526693-crio-socket\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899750 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:22.899691 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:22.899750 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:22.899748 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.399730781 +0000 UTC m=+229.100597791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:22.899858 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899757 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5b844f20-67a5-4eb9-a016-0a37fd526693-crio-socket\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899858 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.899765 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5b844f20-67a5-4eb9-a016-0a37fd526693-data-volume\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:22.899858 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:22.899809 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:22.899951 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:22.899873 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:23.399858709 +0000 UTC m=+229.100725710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : configmap "kube-rbac-proxy" not found Jul 18 00:44:22.909110 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:22.909090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27gc\" (UniqueName: \"kubernetes.io/projected/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-api-access-q27gc\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:23.403842 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:23.403785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:23.403842 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:23.403838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:23.404073 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:23.403917 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:23.404073 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:23.403957 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:23.404073 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:23.403991 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.403975788 +0000 UTC m=+230.104842806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : configmap "kube-rbac-proxy" not found Jul 18 00:44:23.404073 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:23.404008 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:24.404001484 +0000 UTC m=+230.104868480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:24.411941 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:24.411891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:24.411941 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:24.411943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:24.412410 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:24.412016 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:24.412410 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:24.412070 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:24.412410 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:24.412095 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.41207849 +0000 UTC m=+232.112945487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : configmap "kube-rbac-proxy" not found Jul 18 00:44:24.412410 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:24.412115 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:26.412105804 +0000 UTC m=+232.112972804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:25.325684 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:25.325655 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9k4sj_130041cd-4239-4c21-b63d-2efd8ac81a49/dns-node-resolver/0.log" Jul 18 00:44:26.325726 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:26.325700 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-665j9_67549c68-7007-460f-818e-ffecdd166d07/node-ca/0.log" Jul 18 00:44:26.424801 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:26.424766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:26.424801 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:26.424804 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:26.425002 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:26.424893 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:26.425002 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:26.424969 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:26.425090 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:26.424973 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.424953481 +0000 UTC m=+236.125820482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : configmap "kube-rbac-proxy" not found Jul 18 00:44:26.425090 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:26.425031 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:30.425011646 +0000 UTC m=+236.125878649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:27.522877 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:27.522849 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wwgh8_0c76e302-fce9-4b64-96d0-15c3ee3573ab/serve-healthcheck-canary/0.log" Jul 18 00:44:30.456521 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:30.456476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:30.456521 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:30.456519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:30.457036 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:30.456595 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:44:30.457036 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:30.456617 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:44:30.457036 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:30.456660 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.456645372 +0000 UTC m=+244.157512369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : configmap "kube-rbac-proxy" not found Jul 18 00:44:30.457036 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:44:30.456676 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls podName:5b844f20-67a5-4eb9-a016-0a37fd526693 nodeName:}" failed. No retries permitted until 2026-07-18 00:44:38.45666959 +0000 UTC m=+244.157536586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mcpwb" (UID: "5b844f20-67a5-4eb9-a016-0a37fd526693") : secret "insights-runtime-extractor-tls" not found Jul 18 00:44:38.516495 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.516453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:38.516495 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.516495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:38.516988 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.516951 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5b844f20-67a5-4eb9-a016-0a37fd526693-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:38.518759 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.518739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5b844f20-67a5-4eb9-a016-0a37fd526693-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mcpwb\" (UID: \"5b844f20-67a5-4eb9-a016-0a37fd526693\") " pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:38.641536 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.641506 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-56l9r\"" Jul 18 00:44:38.649372 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.649351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mcpwb" Jul 18 00:44:38.765984 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.765954 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mcpwb"] Jul 18 00:44:38.769043 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:44:38.769009 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b844f20_67a5_4eb9_a016_0a37fd526693.slice/crio-6941b7c1b016c41d5de6234b747bffdf2e612ed2fca33dd299cfcc0272b3e5f2 WatchSource:0}: Error finding container 6941b7c1b016c41d5de6234b747bffdf2e612ed2fca33dd299cfcc0272b3e5f2: Status 404 returned error can't find the container with id 6941b7c1b016c41d5de6234b747bffdf2e612ed2fca33dd299cfcc0272b3e5f2 Jul 18 00:44:38.797914 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:38.797881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcpwb" event={"ID":"5b844f20-67a5-4eb9-a016-0a37fd526693","Type":"ContainerStarted","Data":"6941b7c1b016c41d5de6234b747bffdf2e612ed2fca33dd299cfcc0272b3e5f2"} Jul 18 00:44:43.815501 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:43.815418 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcpwb" event={"ID":"5b844f20-67a5-4eb9-a016-0a37fd526693","Type":"ContainerStarted","Data":"96d9b4b6ee1a4d0f4916e76706cdd6ed9103f4b782dba0e13dd532cd9416f48c"} Jul 18 00:44:45.674180 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:45.674142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:44:45.676952 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:45.676924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b06a33fa-efd3-4a44-a5aa-c12c794d26c4-metrics-certs\") pod \"network-metrics-daemon-7vk48\" (UID: \"b06a33fa-efd3-4a44-a5aa-c12c794d26c4\") " pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:44:45.732472 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:45.732434 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65442\"" Jul 18 00:44:45.740349 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:45.740299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vk48" Jul 18 00:44:46.943384 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:46.943358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vk48"] Jul 18 00:44:46.946342 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:44:46.946301 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06a33fa_efd3_4a44_a5aa_c12c794d26c4.slice/crio-6fe46dbac00905e46d60a97338e70c5fb65e2cdeac5d739c08d720f69ea4976e WatchSource:0}: Error finding container 6fe46dbac00905e46d60a97338e70c5fb65e2cdeac5d739c08d720f69ea4976e: Status 404 returned error can't find the container with id 6fe46dbac00905e46d60a97338e70c5fb65e2cdeac5d739c08d720f69ea4976e Jul 18 00:44:47.831397 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:47.831343 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vk48" event={"ID":"b06a33fa-efd3-4a44-a5aa-c12c794d26c4","Type":"ContainerStarted","Data":"6fe46dbac00905e46d60a97338e70c5fb65e2cdeac5d739c08d720f69ea4976e"} Jul 18 00:44:47.833643 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:47.833607 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcpwb" event={"ID":"5b844f20-67a5-4eb9-a016-0a37fd526693","Type":"ContainerStarted","Data":"8e74091b5690db855f400c3dc51a77217f8daa1f8deb260375b132f4da104d57"} Jul 18 00:44:48.838467 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:48.838425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vk48" event={"ID":"b06a33fa-efd3-4a44-a5aa-c12c794d26c4","Type":"ContainerStarted","Data":"66656b3c095cf4d82bc12248afda47363c338ec59257dfb7001b9010bbc4c74f"} Jul 18 00:44:48.838900 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:48.838488 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vk48" event={"ID":"b06a33fa-efd3-4a44-a5aa-c12c794d26c4","Type":"ContainerStarted","Data":"97265f94934fef7b40bbfd534456ad256760f42ae84ffed0042e36697ae1b4f4"} Jul 18 00:44:48.853132 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:48.852905 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7vk48" podStartSLOduration=252.784164429 podStartE2EDuration="4m13.852888287s" totalImagesPullingTime="1.068723858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:40:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:48.852552356 +0000 UTC m=+254.553419378" watchObservedRunningTime="2026-07-18 00:44:48.852888287 +0000 UTC m=+254.553755312" Jul 18 00:44:50.846447 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:50.846407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mcpwb" event={"ID":"5b844f20-67a5-4eb9-a016-0a37fd526693","Type":"ContainerStarted","Data":"161076a91121d6a6e0cfc5ca8d8796c5f14fe5043fa8c705b8c9ce142c647f6b"} Jul 18 00:44:50.865572 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:50.865526 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mcpwb" podStartSLOduration=17.406925283 podStartE2EDuration="28.865511033s" totalImagesPullingTime="11.45858575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:44:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:50.86412869 +0000 UTC m=+256.564995709" watchObservedRunningTime="2026-07-18 00:44:50.865511033 +0000 UTC m=+256.566378052" Jul 18 00:44:53.199658 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.199631 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:44:53.202321 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.202294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.205343 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.205319 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 18 00:44:53.205442 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.205376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 18 00:44:53.205442 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.205392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 18 00:44:53.206227 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.206210 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 18 00:44:53.206334 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.206268 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 18 00:44:53.216379 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.216360 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 18 00:44:53.216581 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.216567 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 18 00:44:53.216646 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.216604 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7fbvj\"" Jul 18 00:44:53.221704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221685 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.221799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.221799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221777 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.221903 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221800 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.221903 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.221903 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.221866 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqr54\" (UniqueName: \"kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.227565 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.227547 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:44:53.322747 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322722 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.322906 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322760 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.322906 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.322906 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.322906 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.323112 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.322940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqr54\" (UniqueName: \"kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.323603 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.323578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.323714 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.323644 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.323714 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.323669 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.325149 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.325133 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.325225 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.325206 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.330384 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.330360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqr54\" (UniqueName: \"kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54\") pod \"console-794744686c-26chz\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.510513 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.510419 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794744686c-26chz" Jul 18 00:44:53.630076 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.630045 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:44:53.632891 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:44:53.632864 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee4fbf9_c8b5_41e3_b333_e2afff264f9b.slice/crio-487f87b9f0d71186edaf842a8435e0e33b87de3e54439abb16dfe9042135a48e WatchSource:0}: Error finding container 487f87b9f0d71186edaf842a8435e0e33b87de3e54439abb16dfe9042135a48e: Status 404 returned error can't find the container with id 487f87b9f0d71186edaf842a8435e0e33b87de3e54439abb16dfe9042135a48e Jul 18 00:44:53.858837 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:53.858750 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794744686c-26chz" event={"ID":"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b","Type":"ContainerStarted","Data":"487f87b9f0d71186edaf842a8435e0e33b87de3e54439abb16dfe9042135a48e"} Jul 18 00:44:56.869636 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:56.869518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794744686c-26chz" event={"ID":"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b","Type":"ContainerStarted","Data":"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f"} Jul 18 00:44:56.884815 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:44:56.884771 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-794744686c-26chz" podStartSLOduration=1.110031896 podStartE2EDuration="3.884756413s" totalImagesPullingTime="2.774724517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:44:56.883993241 +0000 UTC m=+262.584860260" watchObservedRunningTime="2026-07-18 00:44:56.884756413 +0000 UTC m=+262.585623431" Jul 18 00:45:03.511132 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:03.511088 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-794744686c-26chz" Jul 18 00:45:03.511624 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:03.511159 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-794744686c-26chz" Jul 18 00:45:03.512403 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:03.512376 2581 patch_prober.go:28] interesting pod/console-794744686c-26chz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jul 18 00:45:03.512504 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:03.512436 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794744686c-26chz" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jul 18 00:45:09.594559 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.594525 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth"] Jul 18 00:45:09.597815 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.597797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.600078 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.600059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 00:45:09.600347 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.600326 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 00:45:09.601068 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.601024 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 00:45:09.601068 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.601035 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 00:45:09.601268 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.601103 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 00:45:09.601268 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.601157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-wg47p\"" Jul 18 00:45:09.609690 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.609670 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth"] Jul 18 00:45:09.615604 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.615582 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sch2n"] Jul 18 00:45:09.618599 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.618581 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.620872 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.620854 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q86qg\"" Jul 18 00:45:09.620979 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.620897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 00:45:09.621118 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.621101 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 00:45:09.621489 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.621473 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 00:45:09.636323 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-root\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636435 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636405 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636484 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636448 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-metrics-client-ca\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636484 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstlk\" (UniqueName: \"kubernetes.io/projected/1cd302a2-be21-484a-8440-eb16e550aa17-kube-api-access-fstlk\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.636567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-sys\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636567 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636507 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-textfile\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636643 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-wtmp\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636643 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636592 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.636643 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636613 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgfj\" (UniqueName: \"kubernetes.io/projected/6532e939-516b-4e7c-badd-c2322b30072b-kube-api-access-lmgfj\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636643 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636788 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.636788 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.636788 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.636701 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd302a2-be21-484a-8440-eb16e550aa17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.737522 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstlk\" (UniqueName: \"kubernetes.io/projected/1cd302a2-be21-484a-8440-eb16e550aa17-kube-api-access-fstlk\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.737522 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737524 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-sys\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-textfile\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-wtmp\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgfj\" (UniqueName: \"kubernetes.io/projected/6532e939-516b-4e7c-badd-c2322b30072b-kube-api-access-lmgfj\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-sys\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737729 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-wtmp\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.737787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd302a2-be21-484a-8440-eb16e550aa17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-root\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:09.737817 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:09.737870 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls podName:6532e939-516b-4e7c-badd-c2322b30072b nodeName:}" failed. No retries permitted until 2026-07-18 00:45:10.237851659 +0000 UTC m=+275.938718661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls") pod "node-exporter-sch2n" (UID: "6532e939-516b-4e7c-badd-c2322b30072b") : secret "node-exporter-tls" not found Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:09.737881 2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-metrics-client-ca\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:09.737936 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls podName:1cd302a2-be21-484a-8440-eb16e550aa17 nodeName:}" failed. No retries permitted until 2026-07-18 00:45:10.237920235 +0000 UTC m=+275.938787251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-gfqth" (UID: "1cd302a2-be21-484a-8440-eb16e550aa17") : secret "openshift-state-metrics-tls" not found Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.737974 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-textfile\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738264 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.738041 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6532e939-516b-4e7c-badd-c2322b30072b-root\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738760 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.738277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738760 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.738403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6532e939-516b-4e7c-badd-c2322b30072b-metrics-client-ca\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.738760 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.738668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd302a2-be21-484a-8440-eb16e550aa17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.740170 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.740149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:09.740269 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.740257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.745911 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.745886 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstlk\" (UniqueName: \"kubernetes.io/projected/1cd302a2-be21-484a-8440-eb16e550aa17-kube-api-access-fstlk\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:09.746008 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:09.745964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgfj\" (UniqueName: \"kubernetes.io/projected/6532e939-516b-4e7c-badd-c2322b30072b-kube-api-access-lmgfj\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:10.241566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.241531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:10.241566 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.241571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:10.243882 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.243857 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6532e939-516b-4e7c-badd-c2322b30072b-node-exporter-tls\") pod \"node-exporter-sch2n\" (UID: \"6532e939-516b-4e7c-badd-c2322b30072b\") " pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:10.243990 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.243913 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cd302a2-be21-484a-8440-eb16e550aa17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gfqth\" (UID: \"1cd302a2-be21-484a-8440-eb16e550aa17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:10.507063 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.506976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" Jul 18 00:45:10.527287 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.527261 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sch2n" Jul 18 00:45:10.537742 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:45:10.537717 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6532e939_516b_4e7c_badd_c2322b30072b.slice/crio-a77b55fa59b6dcefec3d9dd923145e2aa61fd20ac874d4b6f29ca367fc1bdadc WatchSource:0}: Error finding container a77b55fa59b6dcefec3d9dd923145e2aa61fd20ac874d4b6f29ca367fc1bdadc: Status 404 returned error can't find the container with id a77b55fa59b6dcefec3d9dd923145e2aa61fd20ac874d4b6f29ca367fc1bdadc Jul 18 00:45:10.638582 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.638453 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth"] Jul 18 00:45:10.640883 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:45:10.640855 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd302a2_be21_484a_8440_eb16e550aa17.slice/crio-44d325d474858830b7193ee92e2c497bcce9c45d246c15f5842316f1f10cbeca WatchSource:0}: Error finding container 44d325d474858830b7193ee92e2c497bcce9c45d246c15f5842316f1f10cbeca: Status 404 returned error can't find the container with id 44d325d474858830b7193ee92e2c497bcce9c45d246c15f5842316f1f10cbeca Jul 18 00:45:10.915821 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.915785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sch2n" event={"ID":"6532e939-516b-4e7c-badd-c2322b30072b","Type":"ContainerStarted","Data":"a77b55fa59b6dcefec3d9dd923145e2aa61fd20ac874d4b6f29ca367fc1bdadc"} Jul 18 00:45:10.917602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.917582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" event={"ID":"1cd302a2-be21-484a-8440-eb16e550aa17","Type":"ContainerStarted","Data":"985f6b1dfb4cf7a9b812eabd665fa71a1ea3f752af9d5266374e2138ea48a53c"} Jul 18 00:45:10.917704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.917623 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" event={"ID":"1cd302a2-be21-484a-8440-eb16e550aa17","Type":"ContainerStarted","Data":"f94b7868592c750a47eaa5411ee9331500c6c20879cacc1aa4ab681f5d5eeb2a"} Jul 18 00:45:10.917704 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:10.917642 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" event={"ID":"1cd302a2-be21-484a-8440-eb16e550aa17","Type":"ContainerStarted","Data":"44d325d474858830b7193ee92e2c497bcce9c45d246c15f5842316f1f10cbeca"} Jul 18 00:45:11.923919 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:11.923883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sch2n" event={"ID":"6532e939-516b-4e7c-badd-c2322b30072b","Type":"ContainerStarted","Data":"65e02ee26c09b3cb290f4e1de8fe0da96f658d1716a0e1d03f03c66038482757"} Jul 18 00:45:11.926549 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:11.926518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" event={"ID":"1cd302a2-be21-484a-8440-eb16e550aa17","Type":"ContainerStarted","Data":"9703034c7aa6d064f7528c053393634feab5f5a7e92d80262aa2cd9d6f8d46e7"} Jul 18 00:45:11.956031 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:11.955980 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gfqth" podStartSLOduration=1.895112803 podStartE2EDuration="2.955963197s" totalImagesPullingTime="1.060850394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:11.955342952 +0000 UTC m=+277.656209972" watchObservedRunningTime="2026-07-18 00:45:11.955963197 +0000 UTC m=+277.656830216" Jul 18 00:45:12.931066 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:12.931019 2581 generic.go:356] "Generic (PLEG): container finished" podID="6532e939-516b-4e7c-badd-c2322b30072b" containerID="65e02ee26c09b3cb290f4e1de8fe0da96f658d1716a0e1d03f03c66038482757" exitCode=0 Jul 18 00:45:12.931480 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:12.931111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sch2n" event={"ID":"6532e939-516b-4e7c-badd-c2322b30072b","Type":"ContainerDied","Data":"65e02ee26c09b3cb290f4e1de8fe0da96f658d1716a0e1d03f03c66038482757"} Jul 18 00:45:13.511793 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:13.511760 2581 patch_prober.go:28] interesting pod/console-794744686c-26chz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" start-of-body= Jul 18 00:45:13.511951 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:13.511812 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-794744686c-26chz" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" probeResult="failure" output="Get \"https://10.134.0.11:8443/health\": dial tcp 10.134.0.11:8443: connect: connection refused" Jul 18 00:45:13.936559 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:13.936528 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sch2n" event={"ID":"6532e939-516b-4e7c-badd-c2322b30072b","Type":"ContainerStarted","Data":"5a713e69d82116a6fde2c3fc666a1522305cb448d711735b668323954c304900"} Jul 18 00:45:13.936923 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:13.936576 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sch2n" event={"ID":"6532e939-516b-4e7c-badd-c2322b30072b","Type":"ContainerStarted","Data":"a7531e9e2cd42ecdf35ae1cadd1d0e018dfdfe59a068feb291bccbd3aca28160"} Jul 18 00:45:13.954078 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:13.954030 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sch2n" podStartSLOduration=3.610383116 podStartE2EDuration="4.95401515s" totalImagesPullingTime="1.27916964s" totalInitContainerRuntime="64.462394ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:13.952864945 +0000 UTC m=+279.653732008" watchObservedRunningTime="2026-07-18 00:45:13.95401515 +0000 UTC m=+279.654882169" Jul 18 00:45:14.411319 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.411285 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:45:14.436877 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.436846 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:14.439775 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.439759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.446758 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.446737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 18 00:45:14.450337 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.450296 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:14.476434 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476542 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476445 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476542 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476463 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476542 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476678 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmrtr\" (UniqueName: \"kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476678 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476604 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.476678 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.476620 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.577955 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.577926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578107 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.577979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmrtr\" (UniqueName: \"kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578107 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578107 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578284 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578284 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578284 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578822 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578925 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578803 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.578989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.578921 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.579210 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.579188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.580617 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.580593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.580692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.580645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.585006 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.584985 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmrtr\" (UniqueName: \"kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr\") pod \"console-d5d54f564-x7ln7\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.748886 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.748797 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:14.874925 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.874896 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:14.878143 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:45:14.878116 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c8b09e_d6d8_4a7a_adf4_905956d99589.slice/crio-1eb1a073a811a8ff3bd861e558a064b14c57651b6fd3c5bacecf63c133a397cb WatchSource:0}: Error finding container 1eb1a073a811a8ff3bd861e558a064b14c57651b6fd3c5bacecf63c133a397cb: Status 404 returned error can't find the container with id 1eb1a073a811a8ff3bd861e558a064b14c57651b6fd3c5bacecf63c133a397cb Jul 18 00:45:14.948443 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.948407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d54f564-x7ln7" event={"ID":"46c8b09e-d6d8-4a7a-adf4-905956d99589","Type":"ContainerStarted","Data":"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793"} Jul 18 00:45:14.948865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.948490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d54f564-x7ln7" event={"ID":"46c8b09e-d6d8-4a7a-adf4-905956d99589","Type":"ContainerStarted","Data":"1eb1a073a811a8ff3bd861e558a064b14c57651b6fd3c5bacecf63c133a397cb"} Jul 18 00:45:14.964025 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:14.963975 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d5d54f564-x7ln7" podStartSLOduration=0.963958057 podStartE2EDuration="963.958057ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:14.963055431 +0000 UTC m=+280.663922450" watchObservedRunningTime="2026-07-18 00:45:14.963958057 +0000 UTC m=+280.664825075" Jul 18 00:45:16.557530 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:16.557486 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nj665" podUID="da02bdd2-5e15-45aa-89cf-172b7ef7b342" Jul 18 00:45:16.954673 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:16.954642 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj665" Jul 18 00:45:19.612887 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:19.612852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:45:19.615113 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:19.615092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da02bdd2-5e15-45aa-89cf-172b7ef7b342-metrics-tls\") pod \"dns-default-nj665\" (UID: \"da02bdd2-5e15-45aa-89cf-172b7ef7b342\") " pod="openshift-dns/dns-default-nj665" Jul 18 00:45:19.657645 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:19.657614 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45fg4\"" Jul 18 00:45:19.665532 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:19.665509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nj665" Jul 18 00:45:20.055286 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.055260 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nj665"] Jul 18 00:45:20.057750 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:45:20.057723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda02bdd2_5e15_45aa_89cf_172b7ef7b342.slice/crio-0884280b88341a5ea239906aee90bfdd260abccc65fff3be026dd4749566030f WatchSource:0}: Error finding container 0884280b88341a5ea239906aee90bfdd260abccc65fff3be026dd4749566030f: Status 404 returned error can't find the container with id 0884280b88341a5ea239906aee90bfdd260abccc65fff3be026dd4749566030f Jul 18 00:45:20.122736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.122705 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:45:20.156353 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.156267 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:45:20.156471 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.156381 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.219901 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.219870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220014 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.219907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220014 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.219929 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.220021 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8xx6\" (UniqueName: \"kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.220059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.220078 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.220102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.220096 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.320905 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.320875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8xx6\" (UniqueName: \"kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.320914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.320932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.320949 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.320972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.321002 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321070 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.321042 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.321762 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.321884 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.321853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.322044 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.321912 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.326559 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.322240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.326559 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.323838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.326955 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.326934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.328584 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.328563 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8xx6\" (UniqueName: \"kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6\") pod \"console-55965856bc-7kpj9\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.464707 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.464635 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:20.640123 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.640101 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:45:20.642879 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:45:20.642848 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf1d9c8_4d98_4eb9_9fb9_3cb397534a0b.slice/crio-f3fef0a0c43aead502432a89f40786e211bfba55964e9e57427b0dfcf9b8f1fa WatchSource:0}: Error finding container f3fef0a0c43aead502432a89f40786e211bfba55964e9e57427b0dfcf9b8f1fa: Status 404 returned error can't find the container with id f3fef0a0c43aead502432a89f40786e211bfba55964e9e57427b0dfcf9b8f1fa Jul 18 00:45:20.974856 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.974813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55965856bc-7kpj9" event={"ID":"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b","Type":"ContainerStarted","Data":"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f"} Jul 18 00:45:20.975044 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.974876 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55965856bc-7kpj9" event={"ID":"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b","Type":"ContainerStarted","Data":"f3fef0a0c43aead502432a89f40786e211bfba55964e9e57427b0dfcf9b8f1fa"} Jul 18 00:45:20.976115 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.976070 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj665" event={"ID":"da02bdd2-5e15-45aa-89cf-172b7ef7b342","Type":"ContainerStarted","Data":"0884280b88341a5ea239906aee90bfdd260abccc65fff3be026dd4749566030f"} Jul 18 00:45:20.991492 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:20.991439 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55965856bc-7kpj9" podStartSLOduration=0.991423273 podStartE2EDuration="991.423273ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:45:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:20.989459829 +0000 UTC m=+286.690326849" watchObservedRunningTime="2026-07-18 00:45:20.991423273 +0000 UTC m=+286.692290298" Jul 18 00:45:21.981582 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:21.981490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj665" event={"ID":"da02bdd2-5e15-45aa-89cf-172b7ef7b342","Type":"ContainerStarted","Data":"0016472bd00040d2bf45b0a4f7210971bc0870f92a0be72428896ebf4c206437"} Jul 18 00:45:21.981582 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:21.981549 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nj665" event={"ID":"da02bdd2-5e15-45aa-89cf-172b7ef7b342","Type":"ContainerStarted","Data":"61175cdc71d6468faf93e530cfdb64e327716fbaa2eca6f6cc14de8394bc1561"} Jul 18 00:45:21.997456 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:21.997416 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nj665" podStartSLOduration=251.336730802 podStartE2EDuration="4m12.997401886s" totalImagesPullingTime="1.660671084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:45:21.996036638 +0000 UTC m=+287.696903691" watchObservedRunningTime="2026-07-18 00:45:21.997401886 +0000 UTC m=+287.698268904" Jul 18 00:45:22.986716 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:22.986688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nj665" Jul 18 00:45:24.749369 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:24.749303 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:24.749779 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:24.749395 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:24.750758 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:24.750732 2581 patch_prober.go:28] interesting pod/console-d5d54f564-x7ln7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jul 18 00:45:24.750854 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:24.750777 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-d5d54f564-x7ln7" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jul 18 00:45:30.465545 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:30.465511 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:30.465949 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:30.465566 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:30.470209 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:30.470185 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:31.016817 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:31.016788 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:45:31.057947 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:31.057917 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:31.647524 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:31.647485 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" podUID="22412daa-61d7-48e9-a690-a90fe3e3d66e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 00:45:32.992228 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:32.992199 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nj665" Jul 18 00:45:34.689749 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:34.689722 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:45:34.694585 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:34.694562 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 00:45:34.696840 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:34.696822 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:45:38.385586 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:38.385559 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wwgh8_0c76e302-fce9-4b64-96d0-15c3ee3573ab/serve-healthcheck-canary/0.log" Jul 18 00:45:39.430931 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.430881 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-794744686c-26chz" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" containerID="cri-o://afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f" gracePeriod=15 Jul 18 00:45:39.669224 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.669200 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794744686c-26chz" Jul 18 00:45:39.771411 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771300 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqr54\" (UniqueName: \"kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771411 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771359 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771411 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771387 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771518 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771692 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771641 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert\") pod \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\" (UID: \"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b\") " Jul 18 00:45:39.771860 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771791 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:39.771913 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771860 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-service-ca\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:39.771996 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.771971 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config" (OuterVolumeSpecName: "console-config") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:39.772058 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.772047 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:39.773652 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.773626 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:39.773652 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.773641 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:39.773796 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.773716 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54" (OuterVolumeSpecName: "kube-api-access-wqr54") pod "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" (UID: "9ee4fbf9-c8b5-41e3-b333-e2afff264f9b"). InnerVolumeSpecName "kube-api-access-wqr54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:45:39.873102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.873052 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:39.873102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.873096 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:39.873102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.873106 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-oauth-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:39.873102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.873118 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqr54\" (UniqueName: \"kubernetes.io/projected/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-kube-api-access-wqr54\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:39.873382 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:39.873126 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b-console-oauth-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:40.045102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.045005 2581 generic.go:356] "Generic (PLEG): container finished" podID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerID="afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f" exitCode=0 Jul 18 00:45:40.045102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.045049 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-794744686c-26chz" Jul 18 00:45:40.045102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.045092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794744686c-26chz" event={"ID":"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b","Type":"ContainerDied","Data":"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f"} Jul 18 00:45:40.045362 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.045144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-794744686c-26chz" event={"ID":"9ee4fbf9-c8b5-41e3-b333-e2afff264f9b","Type":"ContainerDied","Data":"487f87b9f0d71186edaf842a8435e0e33b87de3e54439abb16dfe9042135a48e"} Jul 18 00:45:40.045362 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.045166 2581 scope.go:117] "RemoveContainer" containerID="afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f" Jul 18 00:45:40.053301 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.053281 2581 scope.go:117] "RemoveContainer" containerID="afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f" Jul 18 00:45:40.053603 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:40.053583 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f\": container with ID starting with afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f not found: ID does not exist" containerID="afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f" Jul 18 00:45:40.053653 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.053611 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f"} err="failed to get container status \"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f\": rpc error: code = NotFound desc = could not find container \"afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f\": container with ID starting with afc4af51d7aeaa573caa1e8d02e9b5330d0f5af4631c8b1431c66fa8316d6e8f not found: ID does not exist" Jul 18 00:45:40.064093 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.064069 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:45:40.066351 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.066331 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-794744686c-26chz"] Jul 18 00:45:40.834068 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:40.834034 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" path="/var/lib/kubelet/pods/9ee4fbf9-c8b5-41e3-b333-e2afff264f9b/volumes" Jul 18 00:45:41.647752 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:41.647707 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" podUID="22412daa-61d7-48e9-a690-a90fe3e3d66e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 00:45:51.647239 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:51.647198 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" podUID="22412daa-61d7-48e9-a690-a90fe3e3d66e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 18 00:45:51.647696 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:51.647268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" Jul 18 00:45:51.647783 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:51.647764 2581 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"8f894a103f83df1b53e257c99c340a9942ce38aab8b1afad6ca805aad5cf8465"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 18 00:45:51.647819 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:51.647805 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" podUID="22412daa-61d7-48e9-a690-a90fe3e3d66e" containerName="service-proxy" containerID="cri-o://8f894a103f83df1b53e257c99c340a9942ce38aab8b1afad6ca805aad5cf8465" gracePeriod=30 Jul 18 00:45:52.098793 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:52.098711 2581 generic.go:356] "Generic (PLEG): container finished" podID="22412daa-61d7-48e9-a690-a90fe3e3d66e" containerID="8f894a103f83df1b53e257c99c340a9942ce38aab8b1afad6ca805aad5cf8465" exitCode=2 Jul 18 00:45:52.098936 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:52.098784 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerDied","Data":"8f894a103f83df1b53e257c99c340a9942ce38aab8b1afad6ca805aad5cf8465"} Jul 18 00:45:52.098936 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:52.098829 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b8f8854cf-jttsx" event={"ID":"22412daa-61d7-48e9-a690-a90fe3e3d66e","Type":"ContainerStarted","Data":"c3da49e73214a9afc5ee9bc7a04fad911d257b9241d35a828c9ce7ffbfaa69ef"} Jul 18 00:45:56.077333 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.077259 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d5d54f564-x7ln7" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerName="console" containerID="cri-o://57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793" gracePeriod=15 Jul 18 00:45:56.314667 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.314637 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:56.399795 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399765 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.399989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399818 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.399989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399850 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmrtr\" (UniqueName: \"kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.399989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399872 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.399989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.399989 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.399957 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.400227 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.400004 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca\") pod \"46c8b09e-d6d8-4a7a-adf4-905956d99589\" (UID: \"46c8b09e-d6d8-4a7a-adf4-905956d99589\") " Jul 18 00:45:56.400448 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.400334 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:56.400560 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.400370 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:56.400560 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.400446 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config" (OuterVolumeSpecName: "console-config") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:56.400560 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.400527 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca" (OuterVolumeSpecName: "service-ca") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:45:56.402018 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.401996 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:56.402109 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.402021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:45:56.402109 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.402032 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr" (OuterVolumeSpecName: "kube-api-access-fmrtr") pod "46c8b09e-d6d8-4a7a-adf4-905956d99589" (UID: "46c8b09e-d6d8-4a7a-adf4-905956d99589"). InnerVolumeSpecName "kube-api-access-fmrtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:45:56.501491 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501457 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-oauth-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501491 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501483 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmrtr\" (UniqueName: \"kubernetes.io/projected/46c8b09e-d6d8-4a7a-adf4-905956d99589-kube-api-access-fmrtr\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501491 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501495 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-trusted-ca-bundle\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501491 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501503 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501742 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501513 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501742 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501522 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46c8b09e-d6d8-4a7a-adf4-905956d99589-service-ca\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:56.501742 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:56.501531 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46c8b09e-d6d8-4a7a-adf4-905956d99589-console-oauth-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:45:57.117650 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.117565 2581 generic.go:356] "Generic (PLEG): container finished" podID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerID="57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793" exitCode=0 Jul 18 00:45:57.117650 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.117629 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d5d54f564-x7ln7" Jul 18 00:45:57.117650 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.117640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d54f564-x7ln7" event={"ID":"46c8b09e-d6d8-4a7a-adf4-905956d99589","Type":"ContainerDied","Data":"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793"} Jul 18 00:45:57.118267 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.117681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d5d54f564-x7ln7" event={"ID":"46c8b09e-d6d8-4a7a-adf4-905956d99589","Type":"ContainerDied","Data":"1eb1a073a811a8ff3bd861e558a064b14c57651b6fd3c5bacecf63c133a397cb"} Jul 18 00:45:57.118267 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.117700 2581 scope.go:117] "RemoveContainer" containerID="57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793" Jul 18 00:45:57.125490 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.125471 2581 scope.go:117] "RemoveContainer" containerID="57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793" Jul 18 00:45:57.125745 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:45:57.125726 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793\": container with ID starting with 57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793 not found: ID does not exist" containerID="57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793" Jul 18 00:45:57.125808 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.125757 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793"} err="failed to get container status \"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793\": rpc error: code = NotFound desc = could not find container \"57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793\": container with ID starting with 57c0549034621f611dd12a900dcacfc8004c5f7267e9871d865a399241cb4793 not found: ID does not exist" Jul 18 00:45:57.131375 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.131353 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:57.135392 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:57.135371 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d5d54f564-x7ln7"] Jul 18 00:45:58.833426 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:45:58.833394 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" path="/var/lib/kubelet/pods/46c8b09e-d6d8-4a7a-adf4-905956d99589/volumes" Jul 18 00:46:41.551162 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:46:41.551128 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:47:06.570482 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.570416 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55965856bc-7kpj9" podUID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" containerName="console" containerID="cri-o://0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f" gracePeriod=15 Jul 18 00:47:06.806225 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.806202 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:47:06.902450 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902422 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902514 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902545 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902565 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902602 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902596 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8xx6\" (UniqueName: \"kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902851 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902620 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config\") pod \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\" (UID: \"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b\") " Jul 18 00:47:06.902932 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902814 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca" (OuterVolumeSpecName: "service-ca") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:47:06.903010 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902956 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:47:06.903010 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902984 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config" (OuterVolumeSpecName: "console-config") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:47:06.903010 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.902990 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 00:47:06.903169 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.903150 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:06.903169 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.903167 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-oauth-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:06.903360 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.903179 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-service-ca\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:06.903360 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.903194 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-trusted-ca-bundle\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:06.904684 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.904656 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:47:06.905084 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.905055 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 00:47:06.905134 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:06.905075 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6" (OuterVolumeSpecName: "kube-api-access-n8xx6") pod "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" (UID: "4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b"). InnerVolumeSpecName "kube-api-access-n8xx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:47:07.003807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.003777 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-serving-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:07.003807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.003802 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8xx6\" (UniqueName: \"kubernetes.io/projected/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-kube-api-access-n8xx6\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:07.003807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.003812 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b-console-oauth-config\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:47:07.354616 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.354531 2581 generic.go:356] "Generic (PLEG): container finished" podID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" containerID="0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f" exitCode=0 Jul 18 00:47:07.354616 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.354575 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55965856bc-7kpj9" Jul 18 00:47:07.354616 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.354602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55965856bc-7kpj9" event={"ID":"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b","Type":"ContainerDied","Data":"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f"} Jul 18 00:47:07.354816 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.354645 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55965856bc-7kpj9" event={"ID":"4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b","Type":"ContainerDied","Data":"f3fef0a0c43aead502432a89f40786e211bfba55964e9e57427b0dfcf9b8f1fa"} Jul 18 00:47:07.354816 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.354664 2581 scope.go:117] "RemoveContainer" containerID="0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f" Jul 18 00:47:07.362998 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.362980 2581 scope.go:117] "RemoveContainer" containerID="0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f" Jul 18 00:47:07.363255 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:47:07.363236 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f\": container with ID starting with 0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f not found: ID does not exist" containerID="0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f" Jul 18 00:47:07.363327 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.363263 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f"} err="failed to get container status \"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f\": rpc error: code = NotFound desc = could not find container \"0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f\": container with ID starting with 0851f3cb98bda23ea82c819c14213d0f4755cc656563c5895278dd6c1e17cf9f not found: ID does not exist" Jul 18 00:47:07.375101 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.375080 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:47:07.376763 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:07.376742 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55965856bc-7kpj9"] Jul 18 00:47:08.833517 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:08.833486 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" path="/var/lib/kubelet/pods/4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b/volumes" Jul 18 00:47:28.616245 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616204 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7"] Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616447 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616459 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616467 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616474 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616492 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616498 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616533 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf1d9c8-4d98-4eb9-9fb9-3cb397534a0b" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616540 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="46c8b09e-d6d8-4a7a-adf4-905956d99589" containerName="console" Jul 18 00:47:28.616701 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.616547 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee4fbf9-c8b5-41e3-b333-e2afff264f9b" containerName="console" Jul 18 00:47:28.619085 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.619068 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.621486 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.621458 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:47:28.621663 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.621564 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v84kr\"" Jul 18 00:47:28.621663 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.621566 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 18 00:47:28.630496 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.630471 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7"] Jul 18 00:47:28.756325 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.756273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0a0663-334e-41c4-969a-9d27a75501cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.756485 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.756336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjxzc\" (UniqueName: \"kubernetes.io/projected/fa0a0663-334e-41c4-969a-9d27a75501cd-kube-api-access-kjxzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.856998 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.856969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0a0663-334e-41c4-969a-9d27a75501cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.857147 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.857006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjxzc\" (UniqueName: \"kubernetes.io/projected/fa0a0663-334e-41c4-969a-9d27a75501cd-kube-api-access-kjxzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.857348 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.857331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa0a0663-334e-41c4-969a-9d27a75501cd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.867026 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.866964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjxzc\" (UniqueName: \"kubernetes.io/projected/fa0a0663-334e-41c4-969a-9d27a75501cd-kube-api-access-kjxzc\") pod \"cert-manager-operator-controller-manager-55c444bf86-c8dr7\" (UID: \"fa0a0663-334e-41c4-969a-9d27a75501cd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:28.927959 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:28.927931 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" Jul 18 00:47:29.056256 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:29.056221 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7"] Jul 18 00:47:29.059939 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:47:29.059913 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa0a0663_334e_41c4_969a_9d27a75501cd.slice/crio-4f63d087681a454395a1fb99029a3e2065bbcac898f8bb6585f42b833001d6cf WatchSource:0}: Error finding container 4f63d087681a454395a1fb99029a3e2065bbcac898f8bb6585f42b833001d6cf: Status 404 returned error can't find the container with id 4f63d087681a454395a1fb99029a3e2065bbcac898f8bb6585f42b833001d6cf Jul 18 00:47:29.063160 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:29.063139 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:47:29.424196 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:29.424162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" event={"ID":"fa0a0663-334e-41c4-969a-9d27a75501cd","Type":"ContainerStarted","Data":"4f63d087681a454395a1fb99029a3e2065bbcac898f8bb6585f42b833001d6cf"} Jul 18 00:47:32.437348 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:32.437291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" event={"ID":"fa0a0663-334e-41c4-969a-9d27a75501cd","Type":"ContainerStarted","Data":"b58130f7d9adca74a91a19accc8ec059182b748a0ae5e5bc39bf55fc341cd518"} Jul 18 00:47:32.458171 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:32.458119 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c8dr7" podStartSLOduration=1.856117021 podStartE2EDuration="4.458102981s" totalImagesPullingTime="2.60198596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:32.457078967 +0000 UTC m=+418.157945987" watchObservedRunningTime="2026-07-18 00:47:32.458102981 +0000 UTC m=+418.158970000" Jul 18 00:47:42.754939 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.754901 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4w9lq"] Jul 18 00:47:42.759116 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.759099 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.761480 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.761451 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 00:47:42.762300 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.762284 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 00:47:42.762300 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.762325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-sth2r\"" Jul 18 00:47:42.767623 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.767598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4w9lq"] Jul 18 00:47:42.859362 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.859328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-bound-sa-token\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.859519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.859381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zsz\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-kube-api-access-j7zsz\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.959744 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.959707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zsz\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-kube-api-access-j7zsz\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.959901 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.959771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-bound-sa-token\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.967217 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.967188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-bound-sa-token\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:42.967552 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:42.967532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zsz\" (UniqueName: \"kubernetes.io/projected/e221534e-cc70-4fed-9ef2-081e1c6ca036-kube-api-access-j7zsz\") pod \"cert-manager-55b4d954d5-4w9lq\" (UID: \"e221534e-cc70-4fed-9ef2-081e1c6ca036\") " pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:43.068104 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:43.068032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4w9lq" Jul 18 00:47:43.187552 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:43.187521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4w9lq"] Jul 18 00:47:43.190585 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:47:43.190559 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode221534e_cc70_4fed_9ef2_081e1c6ca036.slice/crio-eea9e2dab2a444ac3ac6ff29293bf8af3e59632a9733ec18344a2b50b832eca1 WatchSource:0}: Error finding container eea9e2dab2a444ac3ac6ff29293bf8af3e59632a9733ec18344a2b50b832eca1: Status 404 returned error can't find the container with id eea9e2dab2a444ac3ac6ff29293bf8af3e59632a9733ec18344a2b50b832eca1 Jul 18 00:47:43.477293 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:43.477264 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4w9lq" event={"ID":"e221534e-cc70-4fed-9ef2-081e1c6ca036","Type":"ContainerStarted","Data":"eea9e2dab2a444ac3ac6ff29293bf8af3e59632a9733ec18344a2b50b832eca1"} Jul 18 00:47:46.488762 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:46.488729 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4w9lq" event={"ID":"e221534e-cc70-4fed-9ef2-081e1c6ca036","Type":"ContainerStarted","Data":"a1336906fb5a613ebb060fcc9bd953a0b0a4e240cd00c42dd64bf5ce5b414529"} Jul 18 00:47:46.512041 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:47:46.511991 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4w9lq" podStartSLOduration=2.147744707 podStartE2EDuration="4.511975278s" totalImagesPullingTime="2.364230571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:47:46.5111704 +0000 UTC m=+432.212037423" watchObservedRunningTime="2026-07-18 00:47:46.511975278 +0000 UTC m=+432.212842297" Jul 18 00:48:07.096957 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.096921 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p"] Jul 18 00:48:07.103113 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.103089 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.115375 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.115352 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 00:48:07.115526 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.115508 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 00:48:07.115967 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.115954 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 00:48:07.116114 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.116100 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8pvjh\"" Jul 18 00:48:07.116297 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.116285 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 00:48:07.126645 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.126621 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p"] Jul 18 00:48:07.136120 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.136086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.136234 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.136135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.136234 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.136211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.136341 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.136240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.136341 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.136327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjpcz\" (UniqueName: \"kubernetes.io/projected/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-kube-api-access-mjpcz\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.236665 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.236629 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.236854 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.236670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.236854 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.236730 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjpcz\" (UniqueName: \"kubernetes.io/projected/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-kube-api-access-mjpcz\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.236854 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.236770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.236854 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.236798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.237076 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.237040 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-manifests\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.238993 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.238961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-tmp\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.239198 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.239178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-webhook-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.239294 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.239274 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.255081 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.255058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjpcz\" (UniqueName: \"kubernetes.io/projected/b2a0f0c3-503a-4ffe-95d3-96a485caa7af-kube-api-access-mjpcz\") pod \"opendatahub-operator-controller-manager-794f69c6d-tfv8p\" (UID: \"b2a0f0c3-503a-4ffe-95d3-96a485caa7af\") " pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.412987 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.412950 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:07.547249 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.547224 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p"] Jul 18 00:48:07.549985 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:48:07.549960 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a0f0c3_503a_4ffe_95d3_96a485caa7af.slice/crio-eb7de59e21decdcd51ef3b302a99f9b14e630a26cd554c8a24d515c1917b6a69 WatchSource:0}: Error finding container eb7de59e21decdcd51ef3b302a99f9b14e630a26cd554c8a24d515c1917b6a69: Status 404 returned error can't find the container with id eb7de59e21decdcd51ef3b302a99f9b14e630a26cd554c8a24d515c1917b6a69 Jul 18 00:48:07.560795 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:07.560773 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" event={"ID":"b2a0f0c3-503a-4ffe-95d3-96a485caa7af","Type":"ContainerStarted","Data":"eb7de59e21decdcd51ef3b302a99f9b14e630a26cd554c8a24d515c1917b6a69"} Jul 18 00:48:10.574371 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:10.574340 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" event={"ID":"b2a0f0c3-503a-4ffe-95d3-96a485caa7af","Type":"ContainerStarted","Data":"23f1d2a6be6ed2e6644c449e0412840b57666fee9e404cc51763ad811f84dd65"} Jul 18 00:48:11.582397 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:11.582366 2581 generic.go:356] "Generic (PLEG): container finished" podID="b2a0f0c3-503a-4ffe-95d3-96a485caa7af" containerID="23f1d2a6be6ed2e6644c449e0412840b57666fee9e404cc51763ad811f84dd65" exitCode=0 Jul 18 00:48:11.582880 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:11.582419 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" event={"ID":"b2a0f0c3-503a-4ffe-95d3-96a485caa7af","Type":"ContainerDied","Data":"23f1d2a6be6ed2e6644c449e0412840b57666fee9e404cc51763ad811f84dd65"} Jul 18 00:48:12.587879 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:12.587846 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" event={"ID":"b2a0f0c3-503a-4ffe-95d3-96a485caa7af","Type":"ContainerStarted","Data":"e1dff811b0ba1d0e64b66f0de569d91cf45130325df410b96d6116cd564adafc"} Jul 18 00:48:12.588473 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:12.588004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:12.611689 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:12.611628 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" podStartSLOduration=1.417072251 podStartE2EDuration="5.611608678s" totalImagesPullingTime="3.142206233s" totalInitContainerRuntime="1.052330194s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:12.609408547 +0000 UTC m=+458.310275566" watchObservedRunningTime="2026-07-18 00:48:12.611608678 +0000 UTC m=+458.312475697" Jul 18 00:48:23.594841 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:23.594811 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-794f69c6d-tfv8p" Jul 18 00:48:24.714494 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.714463 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-26qqg"] Jul 18 00:48:24.719795 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.719775 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.723389 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.723369 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 00:48:24.723518 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.723497 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 00:48:24.724396 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.724376 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 00:48:24.724482 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.724460 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5rzbw\"" Jul 18 00:48:24.724555 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.724538 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 00:48:24.729463 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.729448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:48:24.745795 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.745773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-26qqg"] Jul 18 00:48:24.753894 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.753874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b09db53-bf6e-4fad-9a87-a37a06138ce4-manager-config\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.753957 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.753905 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-metrics-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.753957 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.753941 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7bds\" (UniqueName: \"kubernetes.io/projected/0b09db53-bf6e-4fad-9a87-a37a06138ce4-kube-api-access-h7bds\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.754033 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.753988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.854718 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.854688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7bds\" (UniqueName: \"kubernetes.io/projected/0b09db53-bf6e-4fad-9a87-a37a06138ce4-kube-api-access-h7bds\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.854877 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.854723 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.854877 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.854772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b09db53-bf6e-4fad-9a87-a37a06138ce4-manager-config\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.854877 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.854799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-metrics-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.855416 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.855391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b09db53-bf6e-4fad-9a87-a37a06138ce4-manager-config\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.857242 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.857221 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.857242 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.857231 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b09db53-bf6e-4fad-9a87-a37a06138ce4-metrics-cert\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:24.866536 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:24.866516 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7bds\" (UniqueName: \"kubernetes.io/projected/0b09db53-bf6e-4fad-9a87-a37a06138ce4-kube-api-access-h7bds\") pod \"lws-controller-manager-fb6694444-26qqg\" (UID: \"0b09db53-bf6e-4fad-9a87-a37a06138ce4\") " pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:25.028585 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:25.028493 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:25.157803 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:25.157628 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fb6694444-26qqg"] Jul 18 00:48:25.160472 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:48:25.160438 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b09db53_bf6e_4fad_9a87_a37a06138ce4.slice/crio-57c7ecb198a47f1b351b2a80aaf788b15eca3c74640c0376845a657cea9dc4e3 WatchSource:0}: Error finding container 57c7ecb198a47f1b351b2a80aaf788b15eca3c74640c0376845a657cea9dc4e3: Status 404 returned error can't find the container with id 57c7ecb198a47f1b351b2a80aaf788b15eca3c74640c0376845a657cea9dc4e3 Jul 18 00:48:25.638865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:25.638829 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" event={"ID":"0b09db53-bf6e-4fad-9a87-a37a06138ce4","Type":"ContainerStarted","Data":"57c7ecb198a47f1b351b2a80aaf788b15eca3c74640c0376845a657cea9dc4e3"} Jul 18 00:48:28.655062 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:28.655023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" event={"ID":"0b09db53-bf6e-4fad-9a87-a37a06138ce4","Type":"ContainerStarted","Data":"68f84f26f945633f467c8847884a6611adae1cd7fcb4b3cf35578d22b8d31661"} Jul 18 00:48:28.655514 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:28.655163 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:28.672750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:28.672704 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" podStartSLOduration=1.9329587 podStartE2EDuration="4.672685883s" totalImagesPullingTime="2.739727183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:28.670840588 +0000 UTC m=+474.371707607" watchObservedRunningTime="2026-07-18 00:48:28.672685883 +0000 UTC m=+474.373552903" Jul 18 00:48:39.660803 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:39.660772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fb6694444-26qqg" Jul 18 00:48:45.405114 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.405076 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t"] Jul 18 00:48:45.413346 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.413321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.416363 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.416340 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fb592\"" Jul 18 00:48:45.416803 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.416778 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 00:48:45.416905 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.416790 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 00:48:45.416905 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.416825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 00:48:45.503187 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503387 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503407 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzlw9\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-kube-api-access-hzlw9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503427 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6841d542-5b19-45d5-9500-58e8983a0bea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503451 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.503535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.503497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6841d542-5b19-45d5-9500-58e8983a0bea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.537400 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.537355 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t"] Jul 18 00:48:45.603915 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.603874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.603915 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.603917 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6841d542-5b19-45d5-9500-58e8983a0bea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.603938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.603966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.603988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzlw9\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-kube-api-access-hzlw9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604159 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6841d542-5b19-45d5-9500-58e8983a0bea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604534 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604598 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604646 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604725 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604703 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.604883 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.604866 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6841d542-5b19-45d5-9500-58e8983a0bea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.606381 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.606359 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6841d542-5b19-45d5-9500-58e8983a0bea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.606555 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.606534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6841d542-5b19-45d5-9500-58e8983a0bea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.617801 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.617773 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzlw9\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-kube-api-access-hzlw9\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.619589 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.619563 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6841d542-5b19-45d5-9500-58e8983a0bea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678hh79t\" (UID: \"6841d542-5b19-45d5-9500-58e8983a0bea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.724396 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.724289 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:45.883123 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:45.883088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t"] Jul 18 00:48:45.885979 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:48:45.885957 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6841d542_5b19_45d5_9500_58e8983a0bea.slice/crio-a2a38c4d6f7dfe949e0bfba56426692ecf196381c8112ed01573ae6cebac2e8a WatchSource:0}: Error finding container a2a38c4d6f7dfe949e0bfba56426692ecf196381c8112ed01573ae6cebac2e8a: Status 404 returned error can't find the container with id a2a38c4d6f7dfe949e0bfba56426692ecf196381c8112ed01573ae6cebac2e8a Jul 18 00:48:46.728363 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:46.728263 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" event={"ID":"6841d542-5b19-45d5-9500-58e8983a0bea","Type":"ContainerStarted","Data":"a2a38c4d6f7dfe949e0bfba56426692ecf196381c8112ed01573ae6cebac2e8a"} Jul 18 00:48:48.438995 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:48.438952 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:48:48.439258 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:48.439035 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:48:48.439258 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:48.439069 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:48:48.739441 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:48.739348 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" event={"ID":"6841d542-5b19-45d5-9500-58e8983a0bea","Type":"ContainerStarted","Data":"a3c7ab5528e2209f2f12f88a21f53d4e661a9d7f4f1021d1c035d42f86d4880b"} Jul 18 00:48:48.769198 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:48.769139 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" podStartSLOduration=1.218243087 podStartE2EDuration="3.769119066s" totalImagesPullingTime="2.550875979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:48:48.767341164 +0000 UTC m=+494.468208202" watchObservedRunningTime="2026-07-18 00:48:48.769119066 +0000 UTC m=+494.469986087" Jul 18 00:48:49.725491 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:49.725279 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:49.730590 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:49.730561 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:49.743200 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:49.743172 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:48:49.744041 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:48:49.744019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678hh79t" Jul 18 00:49:27.427976 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.427895 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:27.429856 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.429832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:27.432828 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.432799 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 00:49:27.432828 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.432815 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fjj6l\"" Jul 18 00:49:27.433438 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.433418 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 00:49:27.441149 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.441124 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:27.525531 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.525490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q\") pod \"kuadrant-operator-catalog-jz9t2\" (UID: \"518c6ae6-84d0-44f7-8cff-b8ac899f041a\") " pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:27.626721 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.626682 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q\") pod \"kuadrant-operator-catalog-jz9t2\" (UID: \"518c6ae6-84d0-44f7-8cff-b8ac899f041a\") " pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:27.635377 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.635348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q\") pod \"kuadrant-operator-catalog-jz9t2\" (UID: \"518c6ae6-84d0-44f7-8cff-b8ac899f041a\") " pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:27.745739 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.745651 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:27.800490 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.800459 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:27.876535 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.876507 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:27.879743 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:49:27.879716 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518c6ae6_84d0_44f7_8cff_b8ac899f041a.slice/crio-72c8450b55ac1358a0f3a0162f3515ebd3d2187ba490854d0083b4cda73bc152 WatchSource:0}: Error finding container 72c8450b55ac1358a0f3a0162f3515ebd3d2187ba490854d0083b4cda73bc152: Status 404 returned error can't find the container with id 72c8450b55ac1358a0f3a0162f3515ebd3d2187ba490854d0083b4cda73bc152 Jul 18 00:49:27.887428 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:27.887397 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" event={"ID":"518c6ae6-84d0-44f7-8cff-b8ac899f041a","Type":"ContainerStarted","Data":"72c8450b55ac1358a0f3a0162f3515ebd3d2187ba490854d0083b4cda73bc152"} Jul 18 00:49:28.006841 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.006773 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgbld"] Jul 18 00:49:28.009331 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.009301 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:28.017583 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.017560 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgbld"] Jul 18 00:49:28.030495 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.030472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ktg9\" (UniqueName: \"kubernetes.io/projected/68951e49-83d2-4809-bc6a-79f4ece2d445-kube-api-access-8ktg9\") pod \"kuadrant-operator-catalog-vgbld\" (UID: \"68951e49-83d2-4809-bc6a-79f4ece2d445\") " pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:28.131346 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.131298 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ktg9\" (UniqueName: \"kubernetes.io/projected/68951e49-83d2-4809-bc6a-79f4ece2d445-kube-api-access-8ktg9\") pod \"kuadrant-operator-catalog-vgbld\" (UID: \"68951e49-83d2-4809-bc6a-79f4ece2d445\") " pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:28.139355 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.139332 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ktg9\" (UniqueName: \"kubernetes.io/projected/68951e49-83d2-4809-bc6a-79f4ece2d445-kube-api-access-8ktg9\") pod \"kuadrant-operator-catalog-vgbld\" (UID: \"68951e49-83d2-4809-bc6a-79f4ece2d445\") " pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:28.318623 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.318553 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:28.452014 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.451942 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgbld"] Jul 18 00:49:28.474221 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:49:28.474193 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68951e49_83d2_4809_bc6a_79f4ece2d445.slice/crio-399a72966dcf56bbf0b3dd1080ac307570d8b9d4be6d8b49c3e63764aa132641 WatchSource:0}: Error finding container 399a72966dcf56bbf0b3dd1080ac307570d8b9d4be6d8b49c3e63764aa132641: Status 404 returned error can't find the container with id 399a72966dcf56bbf0b3dd1080ac307570d8b9d4be6d8b49c3e63764aa132641 Jul 18 00:49:28.897694 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:28.897618 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" event={"ID":"68951e49-83d2-4809-bc6a-79f4ece2d445","Type":"ContainerStarted","Data":"399a72966dcf56bbf0b3dd1080ac307570d8b9d4be6d8b49c3e63764aa132641"} Jul 18 00:49:29.903895 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:29.903851 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" event={"ID":"518c6ae6-84d0-44f7-8cff-b8ac899f041a","Type":"ContainerStarted","Data":"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c"} Jul 18 00:49:29.904371 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:29.903941 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" podUID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" containerName="registry-server" containerID="cri-o://1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c" gracePeriod=2 Jul 18 00:49:29.905542 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:29.905516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" event={"ID":"68951e49-83d2-4809-bc6a-79f4ece2d445","Type":"ContainerStarted","Data":"ef40602063078b1b61644be2ce0f8f561a3f070c31774de4a3780afa2eecc0b7"} Jul 18 00:49:29.921663 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:29.921617 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" podStartSLOduration=1.063955213 podStartE2EDuration="2.921601736s" totalImagesPullingTime="1.857646523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:49:29.920112998 +0000 UTC m=+535.620980018" watchObservedRunningTime="2026-07-18 00:49:29.921601736 +0000 UTC m=+535.622468755" Jul 18 00:49:29.935889 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:29.935698 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" podStartSLOduration=1.6141801390000001 podStartE2EDuration="2.935679067s" totalImagesPullingTime="1.321498928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:49:29.935031528 +0000 UTC m=+535.635898558" watchObservedRunningTime="2026-07-18 00:49:29.935679067 +0000 UTC m=+535.636546089" Jul 18 00:49:30.145652 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.145626 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:30.249366 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.249330 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q\") pod \"518c6ae6-84d0-44f7-8cff-b8ac899f041a\" (UID: \"518c6ae6-84d0-44f7-8cff-b8ac899f041a\") " Jul 18 00:49:30.251424 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.251403 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q" (OuterVolumeSpecName: "kube-api-access-q2j6q") pod "518c6ae6-84d0-44f7-8cff-b8ac899f041a" (UID: "518c6ae6-84d0-44f7-8cff-b8ac899f041a"). InnerVolumeSpecName "kube-api-access-q2j6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:49:30.350750 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.350669 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2j6q\" (UniqueName: \"kubernetes.io/projected/518c6ae6-84d0-44f7-8cff-b8ac899f041a-kube-api-access-q2j6q\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:49:30.911228 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.911191 2581 generic.go:356] "Generic (PLEG): container finished" podID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" containerID="1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c" exitCode=0 Jul 18 00:49:30.911706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.911233 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" Jul 18 00:49:30.911706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.911278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" event={"ID":"518c6ae6-84d0-44f7-8cff-b8ac899f041a","Type":"ContainerDied","Data":"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c"} Jul 18 00:49:30.911706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.911353 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jz9t2" event={"ID":"518c6ae6-84d0-44f7-8cff-b8ac899f041a","Type":"ContainerDied","Data":"72c8450b55ac1358a0f3a0162f3515ebd3d2187ba490854d0083b4cda73bc152"} Jul 18 00:49:30.911706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.911426 2581 scope.go:117] "RemoveContainer" containerID="1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c" Jul 18 00:49:30.919803 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.919788 2581 scope.go:117] "RemoveContainer" containerID="1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c" Jul 18 00:49:30.920036 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:49:30.920020 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c\": container with ID starting with 1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c not found: ID does not exist" containerID="1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c" Jul 18 00:49:30.920098 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.920047 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c"} err="failed to get container status \"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c\": rpc error: code = NotFound desc = could not find container \"1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c\": container with ID starting with 1c9e11d8127a71a099ec3a37dfd41a2a5c6132e590ac5d6e44fe5bb0b013e87c not found: ID does not exist" Jul 18 00:49:30.927165 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.927143 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:30.929033 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:30.929014 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jz9t2"] Jul 18 00:49:32.833740 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:32.833702 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" path="/var/lib/kubelet/pods/518c6ae6-84d0-44f7-8cff-b8ac899f041a/volumes" Jul 18 00:49:38.318923 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:38.318885 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:38.319494 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:38.318950 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:38.340887 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:38.340863 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:38.962614 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:38.962583 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vgbld" Jul 18 00:49:59.552575 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.552538 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x"] Jul 18 00:49:59.552974 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.552821 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" containerName="registry-server" Jul 18 00:49:59.552974 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.552834 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" containerName="registry-server" Jul 18 00:49:59.552974 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.552882 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="518c6ae6-84d0-44f7-8cff-b8ac899f041a" containerName="registry-server" Jul 18 00:49:59.555858 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.555843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:49:59.558270 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.558248 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bc76x\"" Jul 18 00:49:59.558806 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.558782 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 18 00:49:59.568087 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.568063 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x"] Jul 18 00:49:59.675263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.675231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmwbl\" (UniqueName: \"kubernetes.io/projected/a7f3da57-2044-4091-8587-3499d8e48fa5-kube-api-access-fmwbl\") pod \"dns-operator-controller-manager-864dd78c4c-q5b5x\" (UID: \"a7f3da57-2044-4091-8587-3499d8e48fa5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:49:59.776767 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.776725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmwbl\" (UniqueName: \"kubernetes.io/projected/a7f3da57-2044-4091-8587-3499d8e48fa5-kube-api-access-fmwbl\") pod \"dns-operator-controller-manager-864dd78c4c-q5b5x\" (UID: \"a7f3da57-2044-4091-8587-3499d8e48fa5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:49:59.795427 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.795400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmwbl\" (UniqueName: \"kubernetes.io/projected/a7f3da57-2044-4091-8587-3499d8e48fa5-kube-api-access-fmwbl\") pod \"dns-operator-controller-manager-864dd78c4c-q5b5x\" (UID: \"a7f3da57-2044-4091-8587-3499d8e48fa5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:49:59.865826 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.865723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:49:59.997884 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:49:59.997863 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x"] Jul 18 00:50:00.000740 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:00.000714 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f3da57_2044_4091_8587_3499d8e48fa5.slice/crio-4531189b15953f3281e9c136162dd65adaabfeef91265fb9b7305bd6b3724d4e WatchSource:0}: Error finding container 4531189b15953f3281e9c136162dd65adaabfeef91265fb9b7305bd6b3724d4e: Status 404 returned error can't find the container with id 4531189b15953f3281e9c136162dd65adaabfeef91265fb9b7305bd6b3724d4e Jul 18 00:50:00.020002 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:00.019943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" event={"ID":"a7f3da57-2044-4091-8587-3499d8e48fa5","Type":"ContainerStarted","Data":"4531189b15953f3281e9c136162dd65adaabfeef91265fb9b7305bd6b3724d4e"} Jul 18 00:50:03.036122 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:03.036086 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" event={"ID":"a7f3da57-2044-4091-8587-3499d8e48fa5","Type":"ContainerStarted","Data":"a3dc9f930a4dadcd271c8a9efaf57408b6406ec3bd942e317731ff64c682cd01"} Jul 18 00:50:03.036554 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:03.036225 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:50:03.059193 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:03.059144 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" podStartSLOduration=1.9198409650000001 podStartE2EDuration="4.059128259s" totalImagesPullingTime="2.139287294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:03.056881857 +0000 UTC m=+568.757748896" watchObservedRunningTime="2026-07-18 00:50:03.059128259 +0000 UTC m=+568.759995278" Jul 18 00:50:04.882022 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:04.881989 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn"] Jul 18 00:50:04.886587 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:04.886567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:04.889369 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:04.889351 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rvlhd\"" Jul 18 00:50:04.900790 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:04.900764 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn"] Jul 18 00:50:05.022873 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.022835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfx2\" (UniqueName: \"kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.023058 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.022879 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.123727 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.123686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfx2\" (UniqueName: \"kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.123727 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.123733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.124095 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.124079 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.133146 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.133087 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfx2\" (UniqueName: \"kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.195562 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.195529 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:05.332427 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:05.332403 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn"] Jul 18 00:50:05.335110 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:05.335091 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044b49ac_d1bd_4922_b704_493c27bded08.slice/crio-19f59b2debe780a42d23e3b5cfdbb88f6a4589e26a41d3dfe0b2fcec765eff40 WatchSource:0}: Error finding container 19f59b2debe780a42d23e3b5cfdbb88f6a4589e26a41d3dfe0b2fcec765eff40: Status 404 returned error can't find the container with id 19f59b2debe780a42d23e3b5cfdbb88f6a4589e26a41d3dfe0b2fcec765eff40 Jul 18 00:50:06.052479 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:06.052447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" event={"ID":"044b49ac-d1bd-4922-b704-493c27bded08","Type":"ContainerStarted","Data":"19f59b2debe780a42d23e3b5cfdbb88f6a4589e26a41d3dfe0b2fcec765eff40"} Jul 18 00:50:08.269647 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.269614 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz"] Jul 18 00:50:08.271733 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.271716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:08.276434 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.276414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-d4w24\"" Jul 18 00:50:08.289885 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.289860 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz"] Jul 18 00:50:08.354036 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.354005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hksrb\" (UniqueName: \"kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb\") pod \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" (UID: \"1d4df73d-e145-4410-a14c-cb208bed409c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:08.454414 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.454376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hksrb\" (UniqueName: \"kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb\") pod \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" (UID: \"1d4df73d-e145-4410-a14c-cb208bed409c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:08.478564 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.478533 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hksrb\" (UniqueName: \"kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb\") pod \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" (UID: \"1d4df73d-e145-4410-a14c-cb208bed409c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:08.582454 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.582378 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:08.731525 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:08.731500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz"] Jul 18 00:50:08.734112 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:08.734085 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d4df73d_e145_4410_a14c_cb208bed409c.slice/crio-965a1ad5c317dc45a16fa77577647796877173409c1b79f1d119ab375606ca30 WatchSource:0}: Error finding container 965a1ad5c317dc45a16fa77577647796877173409c1b79f1d119ab375606ca30: Status 404 returned error can't find the container with id 965a1ad5c317dc45a16fa77577647796877173409c1b79f1d119ab375606ca30 Jul 18 00:50:09.067457 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:09.067416 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" event={"ID":"1d4df73d-e145-4410-a14c-cb208bed409c","Type":"ContainerStarted","Data":"965a1ad5c317dc45a16fa77577647796877173409c1b79f1d119ab375606ca30"} Jul 18 00:50:11.076904 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.076873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" event={"ID":"1d4df73d-e145-4410-a14c-cb208bed409c","Type":"ContainerStarted","Data":"af03dc5a4440c17557447ef897abbf2e2bb4994512c7e2f4552888e53e5ead2e"} Jul 18 00:50:11.077268 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.077022 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:11.078421 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.078404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" event={"ID":"044b49ac-d1bd-4922-b704-493c27bded08","Type":"ContainerStarted","Data":"8e64c80e4fba9a590d1608632217b996bbac3b0fc634fafa6fb4969f1485ad20"} Jul 18 00:50:11.078531 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.078519 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:11.098741 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.098701 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" podStartSLOduration=0.8425185 podStartE2EDuration="3.098688237s" totalImagesPullingTime="2.256169737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:11.098375846 +0000 UTC m=+576.799242866" watchObservedRunningTime="2026-07-18 00:50:11.098688237 +0000 UTC m=+576.799555255" Jul 18 00:50:11.124199 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:11.124152 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" podStartSLOduration=1.508922426 podStartE2EDuration="7.124139966s" totalImagesPullingTime="5.61521754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:11.12407295 +0000 UTC m=+576.824939991" watchObservedRunningTime="2026-07-18 00:50:11.124139966 +0000 UTC m=+576.825006985" Jul 18 00:50:14.042136 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:14.042104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-q5b5x" Jul 18 00:50:22.084959 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:22.084920 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:22.085432 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:22.085000 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:23.898016 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.897981 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn"] Jul 18 00:50:23.898478 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.898145 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" podUID="044b49ac-d1bd-4922-b704-493c27bded08" containerName="manager" containerID="cri-o://8e64c80e4fba9a590d1608632217b996bbac3b0fc634fafa6fb4969f1485ad20" gracePeriod=2 Jul 18 00:50:23.908444 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.908419 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn"] Jul 18 00:50:23.910212 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.910183 2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"044b49ac-d1bd-4922-b704-493c27bded08\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\": pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:23.921249 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.921225 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz"] Jul 18 00:50:23.921464 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.921417 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" containerName="manager" containerID="cri-o://af03dc5a4440c17557447ef897abbf2e2bb4994512c7e2f4552888e53e5ead2e" gracePeriod=2 Jul 18 00:50:23.924189 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.924154 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:23.924949 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.924924 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:23.925354 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.925336 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044b49ac-d1bd-4922-b704-493c27bded08" containerName="manager" Jul 18 00:50:23.925354 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.925355 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="044b49ac-d1bd-4922-b704-493c27bded08" containerName="manager" Jul 18 00:50:23.925493 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.925446 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="044b49ac-d1bd-4922-b704-493c27bded08" containerName="manager" Jul 18 00:50:23.928388 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.928370 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz"] Jul 18 00:50:23.928485 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.928472 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:23.933840 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.933811 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:23.938209 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.938184 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:23.943714 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.943688 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:23.947020 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.946998 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w"] Jul 18 00:50:23.947267 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.947254 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" containerName="manager" Jul 18 00:50:23.947322 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.947269 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" containerName="manager" Jul 18 00:50:23.947365 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.947346 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" containerName="manager" Jul 18 00:50:23.950416 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.950402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:23.969652 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:23.969625 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w"] Jul 18 00:50:23.992277 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.992225 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:23.994244 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:23.994208 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.080026 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.079990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dls2r\" (UniqueName: \"kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.080183 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.080049 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.080183 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.080093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h79p\" (UniqueName: \"kubernetes.io/projected/2111b515-43d8-4fa3-9286-b2ab3db6003b-kube-api-access-2h79p\") pod \"limitador-operator-controller-manager-859d7b78bd-9wl4w\" (UID: \"2111b515-43d8-4fa3-9286-b2ab3db6003b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:24.112908 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.112876 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 00:50:24.116258 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.116239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.129116 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.129085 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 00:50:24.137614 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.137588 2581 generic.go:356] "Generic (PLEG): container finished" podID="1d4df73d-e145-4410-a14c-cb208bed409c" containerID="af03dc5a4440c17557447ef897abbf2e2bb4994512c7e2f4552888e53e5ead2e" exitCode=0 Jul 18 00:50:24.139486 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.139464 2581 generic.go:356] "Generic (PLEG): container finished" podID="044b49ac-d1bd-4922-b704-493c27bded08" containerID="8e64c80e4fba9a590d1608632217b996bbac3b0fc634fafa6fb4969f1485ad20" exitCode=0 Jul 18 00:50:24.157183 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.157156 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:24.159703 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.159678 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.171275 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.171258 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:24.173440 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.173417 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:24.173983 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.173965 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.175299 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.175275 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.177199 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.177175 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:24.179137 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.179116 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.181490 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.181472 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h79p\" (UniqueName: \"kubernetes.io/projected/2111b515-43d8-4fa3-9286-b2ab3db6003b-kube-api-access-2h79p\") pod \"limitador-operator-controller-manager-859d7b78bd-9wl4w\" (UID: \"2111b515-43d8-4fa3-9286-b2ab3db6003b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:24.181632 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.181621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dls2r\" (UniqueName: \"kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.181669 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.181655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.181940 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.181926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.189727 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.189711 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dls2r\" (UniqueName: \"kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9n28c\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.189818 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.189801 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h79p\" (UniqueName: \"kubernetes.io/projected/2111b515-43d8-4fa3-9286-b2ab3db6003b-kube-api-access-2h79p\") pod \"limitador-operator-controller-manager-859d7b78bd-9wl4w\" (UID: \"2111b515-43d8-4fa3-9286-b2ab3db6003b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:24.282042 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282012 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hksrb\" (UniqueName: \"kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb\") pod \"1d4df73d-e145-4410-a14c-cb208bed409c\" (UID: \"1d4df73d-e145-4410-a14c-cb208bed409c\") " Jul 18 00:50:24.282171 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282052 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dfx2\" (UniqueName: \"kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2\") pod \"044b49ac-d1bd-4922-b704-493c27bded08\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " Jul 18 00:50:24.282171 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282113 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume\") pod \"044b49ac-d1bd-4922-b704-493c27bded08\" (UID: \"044b49ac-d1bd-4922-b704-493c27bded08\") " Jul 18 00:50:24.282254 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctd9h\" (UniqueName: \"kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.282254 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282239 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.282708 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.282672 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "044b49ac-d1bd-4922-b704-493c27bded08" (UID: "044b49ac-d1bd-4922-b704-493c27bded08"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:50:24.284089 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.284064 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2" (OuterVolumeSpecName: "kube-api-access-9dfx2") pod "044b49ac-d1bd-4922-b704-493c27bded08" (UID: "044b49ac-d1bd-4922-b704-493c27bded08"). InnerVolumeSpecName "kube-api-access-9dfx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:50:24.284179 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.284115 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb" (OuterVolumeSpecName: "kube-api-access-hksrb") pod "1d4df73d-e145-4410-a14c-cb208bed409c" (UID: "1d4df73d-e145-4410-a14c-cb208bed409c"). InnerVolumeSpecName "kube-api-access-hksrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:50:24.344443 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.344410 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:24.351447 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.351420 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:24.383579 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.383807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctd9h\" (UniqueName: \"kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.383807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383708 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/044b49ac-d1bd-4922-b704-493c27bded08-extensions-socket-volume\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:50:24.383807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383726 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hksrb\" (UniqueName: \"kubernetes.io/projected/1d4df73d-e145-4410-a14c-cb208bed409c-kube-api-access-hksrb\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:50:24.383807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383742 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dfx2\" (UniqueName: \"kubernetes.io/projected/044b49ac-d1bd-4922-b704-493c27bded08-kube-api-access-9dfx2\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:50:24.384016 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.383932 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.393770 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.393666 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctd9h\" (UniqueName: \"kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h\") pod \"kuadrant-operator-controller-manager-86878c769f-xvr5t\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.426479 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.426442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:24.504382 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.504354 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:24.507079 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:24.507052 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d2fc372_f731_4ed9_8c60_ecd42f6141dd.slice/crio-275b7986862175f4cf5fded1aa4ad9b1dbbbfd3eefed068a6f8bb73407329b9a WatchSource:0}: Error finding container 275b7986862175f4cf5fded1aa4ad9b1dbbbfd3eefed068a6f8bb73407329b9a: Status 404 returned error can't find the container with id 275b7986862175f4cf5fded1aa4ad9b1dbbbfd3eefed068a6f8bb73407329b9a Jul 18 00:50:24.511408 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.511386 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w"] Jul 18 00:50:24.512954 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:24.512925 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2111b515_43d8_4fa3_9286_b2ab3db6003b.slice/crio-12397054b6bda61517505c280764a998732fddac252e661567abfe942a9e136b WatchSource:0}: Error finding container 12397054b6bda61517505c280764a998732fddac252e661567abfe942a9e136b: Status 404 returned error can't find the container with id 12397054b6bda61517505c280764a998732fddac252e661567abfe942a9e136b Jul 18 00:50:24.610240 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.610125 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 00:50:24.612535 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:24.612511 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea8bcdf_f2a1_47a1_a5b9_68aa3731ea84.slice/crio-1fbca26d1a2300bf3410b4e5d197a8d9aa91bf07846ed0d0a27c7d6e264e5f1a WatchSource:0}: Error finding container 1fbca26d1a2300bf3410b4e5d197a8d9aa91bf07846ed0d0a27c7d6e264e5f1a: Status 404 returned error can't find the container with id 1fbca26d1a2300bf3410b4e5d197a8d9aa91bf07846ed0d0a27c7d6e264e5f1a Jul 18 00:50:24.832954 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.832916 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d8dxn\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="044b49ac-d1bd-4922-b704-493c27bded08" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:24.835727 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:24.835693 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w7zqz\" is forbidden: User \"system:node:ip-10-0-130-15.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-15.ec2.internal' and this object" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:24.836498 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.836477 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044b49ac-d1bd-4922-b704-493c27bded08" path="/var/lib/kubelet/pods/044b49ac-d1bd-4922-b704-493c27bded08/volumes" Jul 18 00:50:24.836793 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:24.836779 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d4df73d-e145-4410-a14c-cb208bed409c" path="/var/lib/kubelet/pods/1d4df73d-e145-4410-a14c-cb208bed409c/volumes" Jul 18 00:50:25.144986 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.144957 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d8dxn" Jul 18 00:50:25.145479 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.144968 2581 scope.go:117] "RemoveContainer" containerID="8e64c80e4fba9a590d1608632217b996bbac3b0fc634fafa6fb4969f1485ad20" Jul 18 00:50:25.146836 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.146805 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" event={"ID":"5d2fc372-f731-4ed9-8c60-ecd42f6141dd","Type":"ContainerStarted","Data":"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01"} Jul 18 00:50:25.146958 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.146869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" event={"ID":"5d2fc372-f731-4ed9-8c60-ecd42f6141dd","Type":"ContainerStarted","Data":"275b7986862175f4cf5fded1aa4ad9b1dbbbfd3eefed068a6f8bb73407329b9a"} Jul 18 00:50:25.147114 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.147095 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:25.148920 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.148888 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" event={"ID":"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84","Type":"ContainerStarted","Data":"baa858e28735d7a1943177e005e33aecbb40448e974f09dd36a133dd8718cae1"} Jul 18 00:50:25.149022 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.148932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" event={"ID":"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84","Type":"ContainerStarted","Data":"1fbca26d1a2300bf3410b4e5d197a8d9aa91bf07846ed0d0a27c7d6e264e5f1a"} Jul 18 00:50:25.149022 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.149013 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:25.153787 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.153760 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" event={"ID":"2111b515-43d8-4fa3-9286-b2ab3db6003b","Type":"ContainerStarted","Data":"07d2dcaebf837e85c8f4d8d821d6964e593f3241569fc9a903558923414b0f90"} Jul 18 00:50:25.153898 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.153808 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" event={"ID":"2111b515-43d8-4fa3-9286-b2ab3db6003b","Type":"ContainerStarted","Data":"12397054b6bda61517505c280764a998732fddac252e661567abfe942a9e136b"} Jul 18 00:50:25.153898 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.153868 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:25.156268 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.156248 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w7zqz" Jul 18 00:50:25.156517 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.156500 2581 scope.go:117] "RemoveContainer" containerID="af03dc5a4440c17557447ef897abbf2e2bb4994512c7e2f4552888e53e5ead2e" Jul 18 00:50:25.167263 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.167224 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" podStartSLOduration=2.167210062 podStartE2EDuration="2.167210062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:25.165431283 +0000 UTC m=+590.866298301" watchObservedRunningTime="2026-07-18 00:50:25.167210062 +0000 UTC m=+590.868077082" Jul 18 00:50:25.183928 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.183855 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" podStartSLOduration=2.18383997 podStartE2EDuration="2.18383997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:25.182641304 +0000 UTC m=+590.883508324" watchObservedRunningTime="2026-07-18 00:50:25.18383997 +0000 UTC m=+590.884706990" Jul 18 00:50:25.200408 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:25.200368 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" podStartSLOduration=1.200353488 podStartE2EDuration="1.200353488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:25.199973818 +0000 UTC m=+590.900840861" watchObservedRunningTime="2026-07-18 00:50:25.200353488 +0000 UTC m=+590.901220506" Jul 18 00:50:34.715872 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:34.715844 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:50:34.719090 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:34.719068 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:50:36.165246 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.165214 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 00:50:36.165753 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.165287 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9wl4w" Jul 18 00:50:36.165753 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.165442 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:36.257460 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.257429 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:36.257664 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.257638 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" podUID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" containerName="manager" containerID="cri-o://34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01" gracePeriod=10 Jul 18 00:50:36.510844 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.510820 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:36.578501 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.578470 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dls2r\" (UniqueName: \"kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r\") pod \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " Jul 18 00:50:36.578666 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.578519 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume\") pod \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\" (UID: \"5d2fc372-f731-4ed9-8c60-ecd42f6141dd\") " Jul 18 00:50:36.578911 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.578889 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d2fc372-f731-4ed9-8c60-ecd42f6141dd" (UID: "5d2fc372-f731-4ed9-8c60-ecd42f6141dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:50:36.580276 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.580256 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r" (OuterVolumeSpecName: "kube-api-access-dls2r") pod "5d2fc372-f731-4ed9-8c60-ecd42f6141dd" (UID: "5d2fc372-f731-4ed9-8c60-ecd42f6141dd"). InnerVolumeSpecName "kube-api-access-dls2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:50:36.679810 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.679727 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dls2r\" (UniqueName: \"kubernetes.io/projected/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-kube-api-access-dls2r\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:50:36.679810 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:36.679756 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d2fc372-f731-4ed9-8c60-ecd42f6141dd-extensions-socket-volume\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:50:37.208297 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.208263 2581 generic.go:356] "Generic (PLEG): container finished" podID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" containerID="34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01" exitCode=0 Jul 18 00:50:37.208782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.208319 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" Jul 18 00:50:37.208782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.208347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" event={"ID":"5d2fc372-f731-4ed9-8c60-ecd42f6141dd","Type":"ContainerDied","Data":"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01"} Jul 18 00:50:37.208782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.208402 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c" event={"ID":"5d2fc372-f731-4ed9-8c60-ecd42f6141dd","Type":"ContainerDied","Data":"275b7986862175f4cf5fded1aa4ad9b1dbbbfd3eefed068a6f8bb73407329b9a"} Jul 18 00:50:37.208782 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.208424 2581 scope.go:117] "RemoveContainer" containerID="34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01" Jul 18 00:50:37.219620 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.219603 2581 scope.go:117] "RemoveContainer" containerID="34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01" Jul 18 00:50:37.219873 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:50:37.219855 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01\": container with ID starting with 34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01 not found: ID does not exist" containerID="34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01" Jul 18 00:50:37.219923 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.219882 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01"} err="failed to get container status \"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01\": rpc error: code = NotFound desc = could not find container \"34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01\": container with ID starting with 34d1d8e997615a0d0e07a61933c30f24a4c9a11f65004da4ecbf296e529f0b01 not found: ID does not exist" Jul 18 00:50:37.231001 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.230981 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:37.240596 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:37.240574 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9n28c"] Jul 18 00:50:38.834668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:38.834629 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" path="/var/lib/kubelet/pods/5d2fc372-f731-4ed9-8c60-ecd42f6141dd/volumes" Jul 18 00:50:52.632355 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.632323 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62"] Jul 18 00:50:52.632736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.632614 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" containerName="manager" Jul 18 00:50:52.632736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.632624 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" containerName="manager" Jul 18 00:50:52.632736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.632677 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d2fc372-f731-4ed9-8c60-ecd42f6141dd" containerName="manager" Jul 18 00:50:52.635109 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.635085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.637519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.637499 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ck5dl\"" Jul 18 00:50:52.655851 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.655818 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62"] Jul 18 00:50:52.699424 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699424 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699425 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699668 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699653 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699680 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699750 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvz26\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-kube-api-access-pvz26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.699865 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.699788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817f8c74-c34d-4a29-8cb8-a33387b9461d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800585 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800631 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvz26\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-kube-api-access-pvz26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800700 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817f8c74-c34d-4a29-8cb8-a33387b9461d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800725 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.800784 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801138 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.800794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801138 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.801033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801138 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.801060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801138 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.801120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801266 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.801179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.801706 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.801686 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817f8c74-c34d-4a29-8cb8-a33387b9461d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.802950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.802927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.803144 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.803123 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.807922 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.807897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvz26\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-kube-api-access-pvz26\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.807922 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.807906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817f8c74-c34d-4a29-8cb8-a33387b9461d-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-nqg62\" (UID: \"817f8c74-c34d-4a29-8cb8-a33387b9461d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:52.944742 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:52.944656 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:53.078705 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.078624 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62"] Jul 18 00:50:53.080939 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:53.080895 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817f8c74_c34d_4a29_8cb8_a33387b9461d.slice/crio-f959dc1064def799a48a20b6c40cafd9d0607e982eca530302c96065ce5e29dc WatchSource:0}: Error finding container f959dc1064def799a48a20b6c40cafd9d0607e982eca530302c96065ce5e29dc: Status 404 returned error can't find the container with id f959dc1064def799a48a20b6c40cafd9d0607e982eca530302c96065ce5e29dc Jul 18 00:50:53.082986 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.082949 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:50:53.083072 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.083020 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:50:53.083072 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.083051 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:50:53.278233 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.278154 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" event={"ID":"817f8c74-c34d-4a29-8cb8-a33387b9461d","Type":"ContainerStarted","Data":"e68b6505f76e6fe4e4af7007ef5af1f295aaf8df4459d39766d738f44db51196"} Jul 18 00:50:53.278233 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.278207 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" event={"ID":"817f8c74-c34d-4a29-8cb8-a33387b9461d","Type":"ContainerStarted","Data":"f959dc1064def799a48a20b6c40cafd9d0607e982eca530302c96065ce5e29dc"} Jul 18 00:50:53.298385 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.298337 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podStartSLOduration=1.298321429 podStartE2EDuration="1.298321429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:53.296924987 +0000 UTC m=+618.997792007" watchObservedRunningTime="2026-07-18 00:50:53.298321429 +0000 UTC m=+618.999188530" Jul 18 00:50:53.945090 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:53.945059 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:54.511694 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.511662 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:50:54.514036 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.514020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.519200 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.519175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kmxzj\"" Jul 18 00:50:54.519434 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.519296 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 18 00:50:54.523501 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.523475 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:50:54.563840 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.563808 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:50:54.620123 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.620087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrztn\" (UniqueName: \"kubernetes.io/projected/f8b5e513-80c3-4d81-a056-b4b883029baa-kube-api-access-mrztn\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.620285 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.620162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8b5e513-80c3-4d81-a056-b4b883029baa-config-file\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.720698 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.720660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrztn\" (UniqueName: \"kubernetes.io/projected/f8b5e513-80c3-4d81-a056-b4b883029baa-kube-api-access-mrztn\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.720884 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.720744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8b5e513-80c3-4d81-a056-b4b883029baa-config-file\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.721433 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.721410 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8b5e513-80c3-4d81-a056-b4b883029baa-config-file\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.732146 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.732113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrztn\" (UniqueName: \"kubernetes.io/projected/f8b5e513-80c3-4d81-a056-b4b883029baa-kube-api-access-mrztn\") pod \"limitador-limitador-54d6d988d5-zp7nw\" (UID: \"f8b5e513-80c3-4d81-a056-b4b883029baa\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.830553 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.830481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:54.950097 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.950069 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:54.961702 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:54.961665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:50:54.964533 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:54.964506 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b5e513_80c3_4d81_a056_b4b883029baa.slice/crio-dd849a026d9f0723f74da68a2fb9a7cb67647badf28747abb13a1f306a605ce2 WatchSource:0}: Error finding container dd849a026d9f0723f74da68a2fb9a7cb67647badf28747abb13a1f306a605ce2: Status 404 returned error can't find the container with id dd849a026d9f0723f74da68a2fb9a7cb67647badf28747abb13a1f306a605ce2 Jul 18 00:50:55.288184 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.288146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" event={"ID":"f8b5e513-80c3-4d81-a056-b4b883029baa","Type":"ContainerStarted","Data":"dd849a026d9f0723f74da68a2fb9a7cb67647badf28747abb13a1f306a605ce2"} Jul 18 00:50:55.288426 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.288345 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:55.289254 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.289235 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:50:55.398212 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.398171 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:50:55.401161 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.401139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:50:55.403990 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.403971 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wqhl\"" Jul 18 00:50:55.409206 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.409185 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:50:55.426005 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.425976 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pn6r\" (UniqueName: \"kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r\") pod \"authorino-75d556bd77-rphxn\" (UID: \"54309d75-bb31-4cc9-9d7b-e31590cb4b0b\") " pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:50:55.526884 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.526853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pn6r\" (UniqueName: \"kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r\") pod \"authorino-75d556bd77-rphxn\" (UID: \"54309d75-bb31-4cc9-9d7b-e31590cb4b0b\") " pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:50:55.535571 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.535517 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pn6r\" (UniqueName: \"kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r\") pod \"authorino-75d556bd77-rphxn\" (UID: \"54309d75-bb31-4cc9-9d7b-e31590cb4b0b\") " pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:50:55.711150 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.711112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:50:55.887657 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:55.887631 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:50:55.890021 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:50:55.889994 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54309d75_bb31_4cc9_9d7b_e31590cb4b0b.slice/crio-3a4a7c1ca706025f7c356d46694c0fa6babe0cdfec3b6941572e5c471576037b WatchSource:0}: Error finding container 3a4a7c1ca706025f7c356d46694c0fa6babe0cdfec3b6941572e5c471576037b: Status 404 returned error can't find the container with id 3a4a7c1ca706025f7c356d46694c0fa6babe0cdfec3b6941572e5c471576037b Jul 18 00:50:56.295091 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:56.295056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rphxn" event={"ID":"54309d75-bb31-4cc9-9d7b-e31590cb4b0b","Type":"ContainerStarted","Data":"3a4a7c1ca706025f7c356d46694c0fa6babe0cdfec3b6941572e5c471576037b"} Jul 18 00:50:58.309102 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:58.309054 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" event={"ID":"f8b5e513-80c3-4d81-a056-b4b883029baa","Type":"ContainerStarted","Data":"5ddd120ffd51f5db8356a256c1d4c11aa567bae8041e30ae9f81bedc5d3c4b4a"} Jul 18 00:50:58.309568 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:58.309261 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:50:58.325370 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:50:58.325329 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" podStartSLOduration=1.614953097 podStartE2EDuration="4.325291217s" totalImagesPullingTime="2.71033812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:50:58.324689857 +0000 UTC m=+624.025556902" watchObservedRunningTime="2026-07-18 00:50:58.325291217 +0000 UTC m=+624.026158239" Jul 18 00:51:00.321298 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:00.321262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rphxn" event={"ID":"54309d75-bb31-4cc9-9d7b-e31590cb4b0b","Type":"ContainerStarted","Data":"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451"} Jul 18 00:51:00.336799 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:00.336744 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rphxn" podStartSLOduration=1.679829585 podStartE2EDuration="5.336729467s" totalImagesPullingTime="3.656899882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:51:00.335693645 +0000 UTC m=+626.036560700" watchObservedRunningTime="2026-07-18 00:51:00.336729467 +0000 UTC m=+626.037596486" Jul 18 00:51:09.315736 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:09.315701 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zp7nw" Jul 18 00:51:25.145513 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.145476 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:51:25.145948 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.145670 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rphxn" podUID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" containerName="authorino" containerID="cri-o://2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451" gracePeriod=30 Jul 18 00:51:25.396686 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.396625 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:51:25.433651 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.433603 2581 generic.go:356] "Generic (PLEG): container finished" podID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" containerID="2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451" exitCode=0 Jul 18 00:51:25.433813 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.433726 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rphxn" event={"ID":"54309d75-bb31-4cc9-9d7b-e31590cb4b0b","Type":"ContainerDied","Data":"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451"} Jul 18 00:51:25.433813 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.433770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rphxn" event={"ID":"54309d75-bb31-4cc9-9d7b-e31590cb4b0b","Type":"ContainerDied","Data":"3a4a7c1ca706025f7c356d46694c0fa6babe0cdfec3b6941572e5c471576037b"} Jul 18 00:51:25.433813 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.433791 2581 scope.go:117] "RemoveContainer" containerID="2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451" Jul 18 00:51:25.433997 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.433982 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rphxn" Jul 18 00:51:25.442379 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.442355 2581 scope.go:117] "RemoveContainer" containerID="2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451" Jul 18 00:51:25.442634 ip-10-0-130-15 kubenswrapper[2581]: E0718 00:51:25.442617 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451\": container with ID starting with 2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451 not found: ID does not exist" containerID="2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451" Jul 18 00:51:25.442684 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.442642 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451"} err="failed to get container status \"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451\": rpc error: code = NotFound desc = could not find container \"2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451\": container with ID starting with 2730ef76fe07eb9ed821cc0b8b3734ea3b039ca795b9d6cc46752db4b3cd5451 not found: ID does not exist" Jul 18 00:51:25.478950 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.478920 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pn6r\" (UniqueName: \"kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r\") pod \"54309d75-bb31-4cc9-9d7b-e31590cb4b0b\" (UID: \"54309d75-bb31-4cc9-9d7b-e31590cb4b0b\") " Jul 18 00:51:25.480807 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.480782 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r" (OuterVolumeSpecName: "kube-api-access-9pn6r") pod "54309d75-bb31-4cc9-9d7b-e31590cb4b0b" (UID: "54309d75-bb31-4cc9-9d7b-e31590cb4b0b"). InnerVolumeSpecName "kube-api-access-9pn6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:51:25.579830 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.579797 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pn6r\" (UniqueName: \"kubernetes.io/projected/54309d75-bb31-4cc9-9d7b-e31590cb4b0b-kube-api-access-9pn6r\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 00:51:25.753663 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.753631 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:51:25.756821 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:25.756795 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rphxn"] Jul 18 00:51:26.833899 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:51:26.833860 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" path="/var/lib/kubelet/pods/54309d75-bb31-4cc9-9d7b-e31590cb4b0b/volumes" Jul 18 00:52:05.580465 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:05.580423 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:52:11.331584 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:11.331523 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nqg62 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 18 00:52:11.332082 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:11.331632 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podUID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 18 00:52:13.638926 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.638894 2581 generic.go:356] "Generic (PLEG): container finished" podID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerID="e68b6505f76e6fe4e4af7007ef5af1f295aaf8df4459d39766d738f44db51196" exitCode=0 Jul 18 00:52:13.639388 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.638931 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" event={"ID":"817f8c74-c34d-4a29-8cb8-a33387b9461d","Type":"ContainerDied","Data":"e68b6505f76e6fe4e4af7007ef5af1f295aaf8df4459d39766d738f44db51196"} Jul 18 00:52:13.639388 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.639279 2581 scope.go:117] "RemoveContainer" containerID="e68b6505f76e6fe4e4af7007ef5af1f295aaf8df4459d39766d738f44db51196" Jul 18 00:52:13.640317 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.640270 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:52:13.640421 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.640355 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:52:13.640421 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:13.640388 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 00:52:14.647612 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:14.647578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" event={"ID":"817f8c74-c34d-4a29-8cb8-a33387b9461d","Type":"ContainerStarted","Data":"780051ec4f14f0ac8a2e1d6f3f9f1c1b00f815be1bbc75a5e20668a17f2a9d19"} Jul 18 00:52:14.945294 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:14.945195 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:52:14.945543 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:14.945511 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nqg62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 18 00:52:14.945645 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:14.945573 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podUID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 18 00:52:15.946118 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:15.946080 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nqg62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 18 00:52:15.946756 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:15.946723 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podUID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 18 00:52:16.946169 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:16.946117 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nqg62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 18 00:52:16.946674 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:16.946191 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podUID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 18 00:52:17.945207 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:17.945168 2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-nqg62 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 18 00:52:17.946203 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:17.946171 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" podUID="817f8c74-c34d-4a29-8cb8-a33387b9461d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 18 00:52:18.949679 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:18.949650 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:52:18.950109 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:18.949921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:52:18.950616 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:18.950600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-nqg62" Jul 18 00:52:27.982754 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:27.982674 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:52:35.773945 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:35.773903 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:52:42.077938 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:52:42.077904 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:53:05.781053 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:05.781005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:53:26.282608 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:26.282571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:53:28.908767 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.908733 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s"] Jul 18 00:53:28.909237 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.909191 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" containerName="authorino" Jul 18 00:53:28.909237 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.909209 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" containerName="authorino" Jul 18 00:53:28.909405 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.909330 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54309d75-bb31-4cc9-9d7b-e31590cb4b0b" containerName="authorino" Jul 18 00:53:28.912189 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.912167 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.915661 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.915634 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 00:53:28.915661 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.915650 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q8kn7\"" Jul 18 00:53:28.915838 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.915662 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 00:53:28.915838 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.915665 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 18 00:53:28.921947 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.921925 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s"] Jul 18 00:53:28.946488 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946457 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.946647 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946497 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz948\" (UniqueName: \"kubernetes.io/projected/2f46f9ee-69ee-481c-a3fe-8415740a6973-kube-api-access-sz948\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.946647 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f46f9ee-69ee-481c-a3fe-8415740a6973-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.946796 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946649 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.946796 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:28.946796 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:28.946725 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047302 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047302 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047525 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz948\" (UniqueName: \"kubernetes.io/projected/2f46f9ee-69ee-481c-a3fe-8415740a6973-kube-api-access-sz948\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047525 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f46f9ee-69ee-481c-a3fe-8415740a6973-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047593 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047532 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047593 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047550 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047694 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047669 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047764 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.047887 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.047868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.049690 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.049669 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2f46f9ee-69ee-481c-a3fe-8415740a6973-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.049948 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.049931 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f46f9ee-69ee-481c-a3fe-8415740a6973-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.055505 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.055484 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz948\" (UniqueName: \"kubernetes.io/projected/2f46f9ee-69ee-481c-a3fe-8415740a6973-kube-api-access-sz948\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s\" (UID: \"2f46f9ee-69ee-481c-a3fe-8415740a6973\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.221153 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.221069 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:29.346519 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.346489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s"] Jul 18 00:53:29.349660 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:53:29.349618 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f46f9ee_69ee_481c_a3fe_8415740a6973.slice/crio-168089c8d9ca334c932280338b1bf862144a08008084cacd28bccbd23cdb0d8b WatchSource:0}: Error finding container 168089c8d9ca334c932280338b1bf862144a08008084cacd28bccbd23cdb0d8b: Status 404 returned error can't find the container with id 168089c8d9ca334c932280338b1bf862144a08008084cacd28bccbd23cdb0d8b Jul 18 00:53:29.351053 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.351034 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:53:29.959349 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:29.959299 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" event={"ID":"2f46f9ee-69ee-481c-a3fe-8415740a6973","Type":"ContainerStarted","Data":"168089c8d9ca334c932280338b1bf862144a08008084cacd28bccbd23cdb0d8b"} Jul 18 00:53:30.964987 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:30.964900 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" event={"ID":"2f46f9ee-69ee-481c-a3fe-8415740a6973","Type":"ContainerStarted","Data":"814827463e3c818769cfd3ba79ebac29d85525b145ae1c1343b2e5c3d9db1cf9"} Jul 18 00:53:30.984189 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:30.984145 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" podStartSLOduration=2.019640407 podStartE2EDuration="2.98413074s" totalImagesPullingTime="964.490333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:53:30.982174363 +0000 UTC m=+776.683041382" watchObservedRunningTime="2026-07-18 00:53:30.98413074 +0000 UTC m=+776.684997759" Jul 18 00:53:37.000240 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:37.000202 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:53:39.221377 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:39.221342 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:39.221771 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:39.221396 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:39.237858 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:39.237831 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:53:40.014963 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:53:40.014934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s" Jul 18 00:54:41.556868 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.556832 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f66845895-5xkh4"] Jul 18 00:54:41.560133 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.560107 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.563525 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.563503 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9wqhl\"" Jul 18 00:54:41.563633 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.563554 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 18 00:54:41.569858 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.569835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66845895-5xkh4"] Jul 18 00:54:41.610959 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.610915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m276d\" (UniqueName: \"kubernetes.io/projected/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-kube-api-access-m276d\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.611098 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.610973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-tls-cert\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.711812 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.711764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m276d\" (UniqueName: \"kubernetes.io/projected/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-kube-api-access-m276d\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.711812 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.711818 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-tls-cert\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.714243 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.714217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-tls-cert\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.718862 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.718836 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m276d\" (UniqueName: \"kubernetes.io/projected/8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa-kube-api-access-m276d\") pod \"authorino-7f66845895-5xkh4\" (UID: \"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa\") " pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.869930 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.869832 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f66845895-5xkh4" Jul 18 00:54:41.994713 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:41.994683 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f66845895-5xkh4"] Jul 18 00:54:41.997653 ip-10-0-130-15 kubenswrapper[2581]: W0718 00:54:41.997623 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a3e4bfa_5a50_4d3e_abfd_846c5e49d8aa.slice/crio-9e5a63835b54da1b47c1fc7b2c3a906ec2be885063c90a709b326abec50cc381 WatchSource:0}: Error finding container 9e5a63835b54da1b47c1fc7b2c3a906ec2be885063c90a709b326abec50cc381: Status 404 returned error can't find the container with id 9e5a63835b54da1b47c1fc7b2c3a906ec2be885063c90a709b326abec50cc381 Jul 18 00:54:42.273198 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:42.273156 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66845895-5xkh4" event={"ID":"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa","Type":"ContainerStarted","Data":"9e5a63835b54da1b47c1fc7b2c3a906ec2be885063c90a709b326abec50cc381"} Jul 18 00:54:43.280367 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:43.280329 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f66845895-5xkh4" event={"ID":"8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa","Type":"ContainerStarted","Data":"1e507e080113a2d696acd994d06892af81d5ec7e95c9feca4dab2d3061387a90"} Jul 18 00:54:43.295499 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:54:43.295443 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f66845895-5xkh4" podStartSLOduration=1.8611396820000001 podStartE2EDuration="2.295420599s" totalImagesPullingTime="434.280917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:54:43.294254013 +0000 UTC m=+848.995121054" watchObservedRunningTime="2026-07-18 00:54:43.295420599 +0000 UTC m=+848.996287621" Jul 18 00:55:12.091451 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:12.091413 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:55:21.486852 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:21.486820 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:55:33.683793 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:33.683751 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:55:34.744385 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:34.744360 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:55:34.744836 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:34.744800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 00:55:41.587776 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:41.587741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:55:53.080537 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:55:53.080497 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:56:19.596611 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:56:19.596571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:56:32.383773 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:56:32.383741 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:06.682121 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:06.682081 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:16.176078 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:16.176041 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:26.287033 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:26.286995 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:32.182353 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:32.182300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:43.074067 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:43.074034 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:57:54.787935 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:57:54.787897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:58:05.480352 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:58:05.480298 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:58:15.485015 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:58:15.484983 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:58:37.688928 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:58:37.688846 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:58:48.582250 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:58:48.582208 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:59:13.177901 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:59:13.177869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:59:24.475911 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:59:24.475879 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:59:38.985339 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:59:38.985286 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 00:59:55.683690 ip-10-0-130-15 kubenswrapper[2581]: I0718 00:59:55.683650 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:00:09.294471 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:09.294433 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:00:19.291282 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:19.291248 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:00:34.768384 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:34.768359 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:00:34.770452 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:34.770430 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:00:43.358731 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:43.358682 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 01:00:43.359258 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:43.358888 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" podUID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" containerName="manager" containerID="cri-o://baa858e28735d7a1943177e005e33aecbb40448e974f09dd36a133dd8718cae1" gracePeriod=10 Jul 18 01:00:46.895445 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:46.895409 2581 generic.go:356] "Generic (PLEG): container finished" podID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" containerID="baa858e28735d7a1943177e005e33aecbb40448e974f09dd36a133dd8718cae1" exitCode=0 Jul 18 01:00:46.895811 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:46.895483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" event={"ID":"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84","Type":"ContainerDied","Data":"baa858e28735d7a1943177e005e33aecbb40448e974f09dd36a133dd8718cae1"} Jul 18 01:00:47.304087 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.304064 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 01:00:47.463608 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.463508 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctd9h\" (UniqueName: \"kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h\") pod \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " Jul 18 01:00:47.463781 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.463651 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume\") pod \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\" (UID: \"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84\") " Jul 18 01:00:47.464024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.463999 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" (UID: "1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:00:47.465475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.465444 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h" (OuterVolumeSpecName: "kube-api-access-ctd9h") pod "1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" (UID: "1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84"). InnerVolumeSpecName "kube-api-access-ctd9h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:00:47.565022 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.564987 2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-extensions-socket-volume\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:00:47.565022 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.565016 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctd9h\" (UniqueName: \"kubernetes.io/projected/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84-kube-api-access-ctd9h\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:00:47.900969 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.900936 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" event={"ID":"1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84","Type":"ContainerDied","Data":"1fbca26d1a2300bf3410b4e5d197a8d9aa91bf07846ed0d0a27c7d6e264e5f1a"} Jul 18 01:00:47.900969 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.900969 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t" Jul 18 01:00:47.901508 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.901000 2581 scope.go:117] "RemoveContainer" containerID="baa858e28735d7a1943177e005e33aecbb40448e974f09dd36a133dd8718cae1" Jul 18 01:00:47.921452 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.921429 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 01:00:47.927097 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:47.927076 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-xvr5t"] Jul 18 01:00:48.834191 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:00:48.834157 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" path="/var/lib/kubelet/pods/1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84/volumes" Jul 18 01:01:44.498625 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.498591 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw"] Jul 18 01:01:44.499048 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.498883 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" containerName="manager" Jul 18 01:01:44.499048 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.498894 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" containerName="manager" Jul 18 01:01:44.499048 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.498970 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea8bcdf-f2a1-47a1-a5b9-68aa3731ea84" containerName="manager" Jul 18 01:01:44.503025 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.503006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.505754 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.505729 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rvlhd\"" Jul 18 01:01:44.517206 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.517178 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw"] Jul 18 01:01:44.608363 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.608293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/241c8201-8979-4c71-ba0a-53b5804fea1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.608554 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.608432 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t9cs\" (UniqueName: \"kubernetes.io/projected/241c8201-8979-4c71-ba0a-53b5804fea1f-kube-api-access-2t9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.709208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.709167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/241c8201-8979-4c71-ba0a-53b5804fea1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.709208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.709216 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t9cs\" (UniqueName: \"kubernetes.io/projected/241c8201-8979-4c71-ba0a-53b5804fea1f-kube-api-access-2t9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.709649 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.709624 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/241c8201-8979-4c71-ba0a-53b5804fea1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.717977 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.717953 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t9cs\" (UniqueName: \"kubernetes.io/projected/241c8201-8979-4c71-ba0a-53b5804fea1f-kube-api-access-2t9cs\") pod \"kuadrant-operator-controller-manager-86878c769f-shlgw\" (UID: \"241c8201-8979-4c71-ba0a-53b5804fea1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.813496 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.813414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:44.952285 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:44.952174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw"] Jul 18 01:01:44.955301 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:01:44.955264 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241c8201_8979_4c71_ba0a_53b5804fea1f.slice/crio-06fbc41fde862ad8975aa667a33f26169b7d0f2529c0b91504b7cba452f23375 WatchSource:0}: Error finding container 06fbc41fde862ad8975aa667a33f26169b7d0f2529c0b91504b7cba452f23375: Status 404 returned error can't find the container with id 06fbc41fde862ad8975aa667a33f26169b7d0f2529c0b91504b7cba452f23375 Jul 18 01:01:45.147102 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:45.147053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" event={"ID":"241c8201-8979-4c71-ba0a-53b5804fea1f","Type":"ContainerStarted","Data":"bd486b3978e862edca9fc22bee17c641de86a3d0a83c558455f2efa58da4682d"} Jul 18 01:01:45.147278 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:45.147125 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" event={"ID":"241c8201-8979-4c71-ba0a-53b5804fea1f","Type":"ContainerStarted","Data":"06fbc41fde862ad8975aa667a33f26169b7d0f2529c0b91504b7cba452f23375"} Jul 18 01:01:45.147278 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:45.147170 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:56.152912 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:56.152882 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" Jul 18 01:01:56.175813 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:01:56.175763 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-shlgw" podStartSLOduration=12.175747259 podStartE2EDuration="12.175747259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:01:45.199997139 +0000 UTC m=+1270.900864177" watchObservedRunningTime="2026-07-18 01:01:56.175747259 +0000 UTC m=+1281.876614277" Jul 18 01:02:04.894349 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:02:04.894291 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:02:14.699865 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:02:14.699819 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:02:28.296872 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:02:28.296832 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:02:40.180801 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:02:40.180763 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:02:51.977653 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:02:51.977616 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:02.914096 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:02.914006 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:10.776024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:10.775984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:21.680473 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:21.680428 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:32.980013 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:32.979978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:40.985753 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:40.985719 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:03:50.578011 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:03:50.577970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:00.388779 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:00.388736 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:19.095491 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:19.095449 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:28.990562 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:28.990464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:38.790346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:38.790294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:48.779890 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:48.779852 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:04:55.485609 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:04:55.485574 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:05:12.093028 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:12.092990 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:05:21.588996 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:21.588956 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:05:30.081856 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:30.081812 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:05:34.800998 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:34.800972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:05:34.801430 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:34.800972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:05:40.481233 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:40.481198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:05:50.087017 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:05:50.086982 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:06:08.382395 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:06:08.382353 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:06:17.387900 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:06:17.387852 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:06:26.986599 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:06:26.986556 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:06:36.850365 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:06:36.850329 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:06:49.180429 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:06:49.180388 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:00.780805 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:00.780766 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:08.879030 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:08.878996 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:20.784454 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:20.784418 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:31.683066 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:31.683008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:43.079431 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:43.079396 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:07:57.374814 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:07:57.374773 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:06.085269 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:06.085230 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:15.785659 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.785624 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:15.789371 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.789347 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.791915 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.791893 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-89911758-openshift-default-dockercfg-5r289\"" Jul 18 01:08:15.807370 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.807347 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:15.882605 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.882571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:15.916224 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqgct\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916426 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916426 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916426 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916426 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916334 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916426 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916671 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916671 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916513 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:15.916671 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:15.916560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.017667 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.017627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.017667 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.017669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.017936 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.017861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqgct\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.017994 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.017979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018050 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018050 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018018 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018155 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018090 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018404 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018455 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.018851 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.018832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.019218 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.019199 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.020565 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.020546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.020709 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.020692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.025681 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.025662 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqgct\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.026024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.026003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token\") pod \"e2e-ait-89911758-openshift-default-696b74687-4k9f5\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.100125 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.100032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:16.235960 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.235933 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:16.237746 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:08:16.237718 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fc6d703_6a86_459f_b0ff_6cca2a85dc15.slice/crio-6302d8211910f846ff88dc987b46f0dce96931e2225b2148b2637ff604d7dcb1 WatchSource:0}: Error finding container 6302d8211910f846ff88dc987b46f0dce96931e2225b2148b2637ff604d7dcb1: Status 404 returned error can't find the container with id 6302d8211910f846ff88dc987b46f0dce96931e2225b2148b2637ff604d7dcb1 Jul 18 01:08:16.240137 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.240104 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:16.240240 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.240170 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:16.240240 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.240196 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:16.890646 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.890610 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" event={"ID":"3fc6d703-6a86-459f-b0ff-6cca2a85dc15","Type":"ContainerStarted","Data":"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107"} Jul 18 01:08:16.891078 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.890660 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" event={"ID":"3fc6d703-6a86-459f-b0ff-6cca2a85dc15","Type":"ContainerStarted","Data":"6302d8211910f846ff88dc987b46f0dce96931e2225b2148b2637ff604d7dcb1"} Jul 18 01:08:16.910469 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:16.910408 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" podStartSLOduration=1.910393877 podStartE2EDuration="1.910393877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:16.90906827 +0000 UTC m=+1662.609935285" watchObservedRunningTime="2026-07-18 01:08:16.910393877 +0000 UTC m=+1662.611260897" Jul 18 01:08:17.101183 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:17.101143 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:17.106286 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:17.106262 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:17.895257 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:17.895223 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:17.896102 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:17.896079 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:22.202189 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:22.202146 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:22.202575 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:22.202339 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" podUID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" containerName="istio-proxy" containerID="cri-o://9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107" gracePeriod=30 Jul 18 01:08:28.140175 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.140115 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:28.224331 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224230 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224331 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224294 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqgct\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224348 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224385 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224423 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224457 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224490 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224543 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224527 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.224745 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.224553 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert\") pod \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\" (UID: \"3fc6d703-6a86-459f-b0ff-6cca2a85dc15\") " Jul 18 01:08:28.227701 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.227597 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:28.227701 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.227661 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:28.227979 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.227929 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:28.228333 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.228130 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:28.228423 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.228340 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:08:28.229731 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.229706 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:08:28.229942 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.229918 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:28.230001 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.229933 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:28.230223 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.230205 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct" (OuterVolumeSpecName: "kube-api-access-mqgct") pod "3fc6d703-6a86-459f-b0ff-6cca2a85dc15" (UID: "3fc6d703-6a86-459f-b0ff-6cca2a85dc15"). InnerVolumeSpecName "kube-api-access-mqgct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:28.326201 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326165 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqgct\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-kube-api-access-mqgct\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326201 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326203 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326219 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326232 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326245 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326258 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326271 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326283 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.326475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.326295 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fc6d703-6a86-459f-b0ff-6cca2a85dc15-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:28.437165 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.437133 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:28.437507 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.437492 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" containerName="istio-proxy" Jul 18 01:08:28.437564 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.437509 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" containerName="istio-proxy" Jul 18 01:08:28.437599 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.437568 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" containerName="istio-proxy" Jul 18 01:08:28.448210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.448186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.451004 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.450981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1af78f27-openshift-default-dockercfg-9bsf8\"" Jul 18 01:08:28.452160 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.452135 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:28.528835 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.528760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.528835 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.528801 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529008 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.528877 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529008 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.528936 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529094 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.528998 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529094 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.529041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7zn\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529171 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.529093 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529171 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.529130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.529246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.529193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.629763 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629726 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.629925 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.629925 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.629925 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.629925 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630146 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630146 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.629966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7zn\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630146 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630146 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630375 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630437 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630369 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630762 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630733 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630882 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.630882 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.630741 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.632396 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.632375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.632481 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.632463 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.637958 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.637939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.638100 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.638081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7zn\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn\") pod \"e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.761324 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.761274 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:28.891932 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.891906 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:28.893678 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:08:28.893652 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf884a361_098a_409c_a5ab_5d4fc0a283db.slice/crio-c8ee1484218192108b6b02a0b8205c70e44d17fd8af386a3b6259326462b6d10 WatchSource:0}: Error finding container c8ee1484218192108b6b02a0b8205c70e44d17fd8af386a3b6259326462b6d10: Status 404 returned error can't find the container with id c8ee1484218192108b6b02a0b8205c70e44d17fd8af386a3b6259326462b6d10 Jul 18 01:08:28.895699 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.895666 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:28.895803 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.895726 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:28.895803 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.895755 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:28.945956 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.945927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" event={"ID":"f884a361-098a-409c-a5ab-5d4fc0a283db","Type":"ContainerStarted","Data":"c8ee1484218192108b6b02a0b8205c70e44d17fd8af386a3b6259326462b6d10"} Jul 18 01:08:28.947340 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.947298 2581 generic.go:356] "Generic (PLEG): container finished" podID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" containerID="9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107" exitCode=0 Jul 18 01:08:28.947443 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.947356 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" Jul 18 01:08:28.947443 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.947364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" event={"ID":"3fc6d703-6a86-459f-b0ff-6cca2a85dc15","Type":"ContainerDied","Data":"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107"} Jul 18 01:08:28.947443 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.947404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5" event={"ID":"3fc6d703-6a86-459f-b0ff-6cca2a85dc15","Type":"ContainerDied","Data":"6302d8211910f846ff88dc987b46f0dce96931e2225b2148b2637ff604d7dcb1"} Jul 18 01:08:28.947443 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.947428 2581 scope.go:117] "RemoveContainer" containerID="9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107" Jul 18 01:08:28.956114 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.956098 2581 scope.go:117] "RemoveContainer" containerID="9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107" Jul 18 01:08:28.956452 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:08:28.956431 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107\": container with ID starting with 9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107 not found: ID does not exist" containerID="9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107" Jul 18 01:08:28.956521 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.956460 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107"} err="failed to get container status \"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107\": rpc error: code = NotFound desc = could not find container \"9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107\": container with ID starting with 9e23b4d5ac1d1db23eae15b37b8d109ff7cbd80e0508d1b3faf94532dccb1107 not found: ID does not exist" Jul 18 01:08:28.964990 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.964958 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:28.967854 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:28.967834 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-89911758-openshift-default-696b74687-4k9f5"] Jul 18 01:08:29.954389 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:29.954352 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" event={"ID":"f884a361-098a-409c-a5ab-5d4fc0a283db","Type":"ContainerStarted","Data":"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd"} Jul 18 01:08:29.983574 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:29.983512 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" podStartSLOduration=1.983496288 podStartE2EDuration="1.983496288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:29.980991458 +0000 UTC m=+1675.681858485" watchObservedRunningTime="2026-07-18 01:08:29.983496288 +0000 UTC m=+1675.684363306" Jul 18 01:08:30.762496 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:30.762458 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:30.767388 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:30.767364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:30.834873 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:30.834837 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fc6d703-6a86-459f-b0ff-6cca2a85dc15" path="/var/lib/kubelet/pods/3fc6d703-6a86-459f-b0ff-6cca2a85dc15/volumes" Jul 18 01:08:30.962791 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:30.962759 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:30.966696 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:30.966669 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:32.980949 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:32.980911 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:40.791827 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:40.791724 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:40.792244 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:40.791942 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" podUID="f884a361-098a-409c-a5ab-5d4fc0a283db" containerName="istio-proxy" containerID="cri-o://d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd" gracePeriod=30 Jul 18 01:08:40.940742 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:40.940713 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:41.008501 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.008469 2581 generic.go:356] "Generic (PLEG): container finished" podID="f884a361-098a-409c-a5ab-5d4fc0a283db" containerID="d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd" exitCode=0 Jul 18 01:08:41.008669 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.008522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" event={"ID":"f884a361-098a-409c-a5ab-5d4fc0a283db","Type":"ContainerDied","Data":"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd"} Jul 18 01:08:41.008669 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.008531 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" Jul 18 01:08:41.008669 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.008564 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z" event={"ID":"f884a361-098a-409c-a5ab-5d4fc0a283db","Type":"ContainerDied","Data":"c8ee1484218192108b6b02a0b8205c70e44d17fd8af386a3b6259326462b6d10"} Jul 18 01:08:41.008669 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.008587 2581 scope.go:117] "RemoveContainer" containerID="d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd" Jul 18 01:08:41.016744 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.016718 2581 scope.go:117] "RemoveContainer" containerID="d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd" Jul 18 01:08:41.017025 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:08:41.017001 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd\": container with ID starting with d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd not found: ID does not exist" containerID="d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd" Jul 18 01:08:41.017090 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.017038 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd"} err="failed to get container status \"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd\": rpc error: code = NotFound desc = could not find container \"d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd\": container with ID starting with d980cedeb79e64c73bc7bdc28675105c9c394fff9774df4c2338a87d8e2678dd not found: ID does not exist" Jul 18 01:08:41.038345 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038298 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038454 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038356 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh7zn\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038454 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038395 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038454 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038420 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038568 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038468 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038568 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038491 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038568 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038568 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038557 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038711 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038588 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo\") pod \"f884a361-098a-409c-a5ab-5d4fc0a283db\" (UID: \"f884a361-098a-409c-a5ab-5d4fc0a283db\") " Jul 18 01:08:41.038749 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038643 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:08:41.038749 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038727 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:41.038897 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038877 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f884a361-098a-409c-a5ab-5d4fc0a283db-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.038955 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038902 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.039010 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.038968 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:41.039066 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.039050 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:41.039463 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.039443 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data" (OuterVolumeSpecName: "istio-data") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:41.040728 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.040703 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token" (OuterVolumeSpecName: "istio-token") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:41.040815 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.040775 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:08:41.040985 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.040963 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn" (OuterVolumeSpecName: "kube-api-access-hh7zn") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "kube-api-access-hh7zn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:41.041090 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.040965 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f884a361-098a-409c-a5ab-5d4fc0a283db" (UID: "f884a361-098a-409c-a5ab-5d4fc0a283db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:41.139706 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139667 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.139706 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139692 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.139706 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139700 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.139706 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139709 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.139706 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139719 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.140079 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139728 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh7zn\" (UniqueName: \"kubernetes.io/projected/f884a361-098a-409c-a5ab-5d4fc0a283db-kube-api-access-hh7zn\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.140079 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.139737 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f884a361-098a-409c-a5ab-5d4fc0a283db-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:41.332258 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.332225 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:41.333821 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:41.333800 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1af78f27-openshift-default-67c9759495-mcq6z"] Jul 18 01:08:42.834160 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:42.834126 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f884a361-098a-409c-a5ab-5d4fc0a283db" path="/var/lib/kubelet/pods/f884a361-098a-409c-a5ab-5d4fc0a283db/volumes" Jul 18 01:08:44.980475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:44.980442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:47.226153 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.226118 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:08:47.226656 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.226466 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f884a361-098a-409c-a5ab-5d4fc0a283db" containerName="istio-proxy" Jul 18 01:08:47.226656 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.226485 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f884a361-098a-409c-a5ab-5d4fc0a283db" containerName="istio-proxy" Jul 18 01:08:47.226656 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.226576 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f884a361-098a-409c-a5ab-5d4fc0a283db" containerName="istio-proxy" Jul 18 01:08:47.229266 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.229239 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.232395 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.232367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-42e43dea-openshift-default-dockercfg-fkqqk\"" Jul 18 01:08:47.241523 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.241496 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:08:47.292162 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292131 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292354 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292354 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292354 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292277 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292480 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292363 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292480 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292401 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxvng\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292480 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292480 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292458 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.292480 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.292478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393536 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393495 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393536 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393752 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393752 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393721 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393822 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393822 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxvng\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393982 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393961 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.393982 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.393951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394110 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394110 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394110 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394101 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394497 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394472 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394591 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394499 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.394591 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.394527 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.396008 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.395977 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.396171 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.396155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.402301 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.402278 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.402409 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.402288 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxvng\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng\") pod \"e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.540195 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.540101 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:47.676484 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.676457 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:08:47.678808 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:08:47.678773 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b7c16f_710d_4537_9af9_af9b5d3d58d7.slice/crio-e62a8918f34f5465f3f851b0c921534e9ba77ebaaea392b5e115d76a76cc05d6 WatchSource:0}: Error finding container e62a8918f34f5465f3f851b0c921534e9ba77ebaaea392b5e115d76a76cc05d6: Status 404 returned error can't find the container with id e62a8918f34f5465f3f851b0c921534e9ba77ebaaea392b5e115d76a76cc05d6 Jul 18 01:08:47.680817 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.680786 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:47.680915 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.680856 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:47.680915 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:47.680903 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:08:48.043553 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:48.043515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" event={"ID":"78b7c16f-710d-4537-9af9-af9b5d3d58d7","Type":"ContainerStarted","Data":"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852"} Jul 18 01:08:48.043756 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:48.043575 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" event={"ID":"78b7c16f-710d-4537-9af9-af9b5d3d58d7","Type":"ContainerStarted","Data":"e62a8918f34f5465f3f851b0c921534e9ba77ebaaea392b5e115d76a76cc05d6"} Jul 18 01:08:48.063644 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:48.063593 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" podStartSLOduration=1.06357745 podStartE2EDuration="1.06357745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:08:48.062450512 +0000 UTC m=+1693.763317529" watchObservedRunningTime="2026-07-18 01:08:48.06357745 +0000 UTC m=+1693.764444803" Jul 18 01:08:48.541334 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:48.541265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:48.546290 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:48.546264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:49.048299 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:49.048268 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:49.049194 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:49.049178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:51.778945 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:51.778908 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:08:52.975970 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:52.975937 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:08:52.976408 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:52.976128 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" podUID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" containerName="istio-proxy" containerID="cri-o://82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852" gracePeriod=30 Jul 18 01:08:59.534999 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.534962 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:08:59.709133 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709101 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709160 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709185 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709211 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxvng\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709234 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709268 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709338 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709686 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709389 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709686 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709411 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket\") pod \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\" (UID: \"78b7c16f-710d-4537-9af9-af9b5d3d58d7\") " Jul 18 01:08:59.709686 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709542 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:59.709842 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709737 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.709842 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709771 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:59.709941 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.709912 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:59.710114 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.710091 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:08:59.710182 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.710161 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:59.711520 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.711492 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:08:59.711520 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.711508 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng" (OuterVolumeSpecName: "kube-api-access-rxvng") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "kube-api-access-rxvng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:59.711807 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.711781 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:08:59.711904 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.711813 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "78b7c16f-710d-4537-9af9-af9b5d3d58d7" (UID: "78b7c16f-710d-4537-9af9-af9b5d3d58d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:08:59.810296 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810259 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810296 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810291 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxvng\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-kube-api-access-rxvng\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810296 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810301 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810337 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810349 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810361 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810373 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:08:59.810539 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:08:59.810384 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/78b7c16f-710d-4537-9af9-af9b5d3d58d7-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:09:00.100580 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.100492 2581 generic.go:356] "Generic (PLEG): container finished" podID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" containerID="82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852" exitCode=0 Jul 18 01:09:00.100580 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.100531 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" event={"ID":"78b7c16f-710d-4537-9af9-af9b5d3d58d7","Type":"ContainerDied","Data":"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852"} Jul 18 01:09:00.100580 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.100535 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" Jul 18 01:09:00.100580 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.100572 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm" event={"ID":"78b7c16f-710d-4537-9af9-af9b5d3d58d7","Type":"ContainerDied","Data":"e62a8918f34f5465f3f851b0c921534e9ba77ebaaea392b5e115d76a76cc05d6"} Jul 18 01:09:00.100881 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.100595 2581 scope.go:117] "RemoveContainer" containerID="82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852" Jul 18 01:09:00.109443 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.109416 2581 scope.go:117] "RemoveContainer" containerID="82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852" Jul 18 01:09:00.109746 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:09:00.109727 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852\": container with ID starting with 82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852 not found: ID does not exist" containerID="82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852" Jul 18 01:09:00.109804 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.109755 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852"} err="failed to get container status \"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852\": rpc error: code = NotFound desc = could not find container \"82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852\": container with ID starting with 82654d30ca76eb2d11ed179da7b34c43993c5e9f22eb6c85a5bfd84d6038e852 not found: ID does not exist" Jul 18 01:09:00.121123 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.121089 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:09:00.125806 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.125775 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-42e43dea-openshift-default-5f6c8d86dc-5qrzm"] Jul 18 01:09:00.834911 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:00.834875 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" path="/var/lib/kubelet/pods/78b7c16f-710d-4537-9af9-af9b5d3d58d7/volumes" Jul 18 01:09:03.286277 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:09:03.286240 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:10:23.176452 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:23.176419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:10:32.579743 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:32.579711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:10:34.828237 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:34.828210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:10:34.829908 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:34.829878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:10:44.383686 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:44.383644 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:10:55.379369 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:10:55.379329 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:11:27.080910 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:27.080872 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:11:41.618050 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.618011 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:11:41.618645 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.618326 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" containerName="istio-proxy" Jul 18 01:11:41.618645 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.618337 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" containerName="istio-proxy" Jul 18 01:11:41.618645 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.618396 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78b7c16f-710d-4537-9af9-af9b5d3d58d7" containerName="istio-proxy" Jul 18 01:11:41.620540 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.620519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.622921 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.622894 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3482f028\"/\"openshift-service-ca.crt\"" Jul 18 01:11:41.623742 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.623719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3482f028\"/\"default-dockercfg-rdk7b\"" Jul 18 01:11:41.623858 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.623760 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-3482f028\"/\"kube-root-ca.crt\"" Jul 18 01:11:41.623858 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.623812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-3482f028\"/\"e2e-lifecycle-model-3482f028-kserve-self-signed-certs\"" Jul 18 01:11:41.630411 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630382 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.630517 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shkf8\" (UniqueName: \"kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.630517 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630496 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.630628 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630525 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.630628 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.630747 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.630682 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.631174 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.631154 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:11:41.731848 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731813 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shkf8\" (UniqueName: \"kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.731963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732268 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.732235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732367 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.732349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.732431 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.732408 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.734147 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.734126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.734482 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.734465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.739976 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.739952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shkf8\" (UniqueName: \"kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8\") pod \"e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:41.929591 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:41.929546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:42.060799 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:42.060772 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:11:42.063268 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:11:42.063241 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4dcfd4f3_24bf_4391_ac63_467254956886.slice/crio-d0d2842b2852cae1507088c6a379081f071f6582a3422107f5c7c016d42ab43d WatchSource:0}: Error finding container d0d2842b2852cae1507088c6a379081f071f6582a3422107f5c7c016d42ab43d: Status 404 returned error can't find the container with id d0d2842b2852cae1507088c6a379081f071f6582a3422107f5c7c016d42ab43d Jul 18 01:11:42.811765 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:42.811725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" event={"ID":"4dcfd4f3-24bf-4391-ac63-467254956886","Type":"ContainerStarted","Data":"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7"} Jul 18 01:11:42.811765 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:42.811770 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" event={"ID":"4dcfd4f3-24bf-4391-ac63-467254956886","Type":"ContainerStarted","Data":"d0d2842b2852cae1507088c6a379081f071f6582a3422107f5c7c016d42ab43d"} Jul 18 01:11:42.826659 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:42.826612 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" podStartSLOduration=1.8265967619999999 podStartE2EDuration="1.826596762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:11:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:11:42.825491659 +0000 UTC m=+1868.526358678" watchObservedRunningTime="2026-07-18 01:11:42.826596762 +0000 UTC m=+1868.527463780" Jul 18 01:11:44.991290 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:44.991258 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:11:51.930560 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:51.930515 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:51.931161 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:51.930583 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:51.943346 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:51.943302 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:11:52.876297 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:11:52.876265 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:12:10.582636 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:10.582598 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:12:24.085109 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:24.085074 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:12:24.136272 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:24.136230 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:12:39.156507 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.156459 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" podUID="4dcfd4f3-24bf-4391-ac63-467254956886" containerName="main" containerID="cri-o://73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7" gracePeriod=45 Jul 18 01:12:39.403230 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.403205 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:12:39.427076 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427001 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427226 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427119 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427226 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427155 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427226 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427219 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shkf8\" (UniqueName: \"kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427485 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427243 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427485 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427290 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm\") pod \"4dcfd4f3-24bf-4391-ac63-467254956886\" (UID: \"4dcfd4f3-24bf-4391-ac63-467254956886\") " Jul 18 01:12:39.427485 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427363 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:12:39.427646 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427551 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home" (OuterVolumeSpecName: "home") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:12:39.427646 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427604 2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-tmp-dir\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:39.427833 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.427809 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache" (OuterVolumeSpecName: "model-cache") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:12:39.429455 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.429430 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 18 01:12:39.429689 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.429662 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm" (OuterVolumeSpecName: "dshm") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:12:39.430023 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.430000 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8" (OuterVolumeSpecName: "kube-api-access-shkf8") pod "4dcfd4f3-24bf-4391-ac63-467254956886" (UID: "4dcfd4f3-24bf-4391-ac63-467254956886"). InnerVolumeSpecName "kube-api-access-shkf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:12:39.528563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.528536 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shkf8\" (UniqueName: \"kubernetes.io/projected/4dcfd4f3-24bf-4391-ac63-467254956886-kube-api-access-shkf8\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:39.528563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.528561 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-model-cache\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:39.528563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.528571 2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-dshm\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:39.528783 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.528578 2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4dcfd4f3-24bf-4391-ac63-467254956886-tls-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:39.528783 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:39.528586 2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4dcfd4f3-24bf-4391-ac63-467254956886-home\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:12:40.086622 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.086590 2581 generic.go:356] "Generic (PLEG): container finished" podID="4dcfd4f3-24bf-4391-ac63-467254956886" containerID="73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7" exitCode=0 Jul 18 01:12:40.086839 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.086647 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" Jul 18 01:12:40.086839 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.086657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" event={"ID":"4dcfd4f3-24bf-4391-ac63-467254956886","Type":"ContainerDied","Data":"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7"} Jul 18 01:12:40.086839 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.086696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5" event={"ID":"4dcfd4f3-24bf-4391-ac63-467254956886","Type":"ContainerDied","Data":"d0d2842b2852cae1507088c6a379081f071f6582a3422107f5c7c016d42ab43d"} Jul 18 01:12:40.086839 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.086717 2581 scope.go:117] "RemoveContainer" containerID="73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7" Jul 18 01:12:40.095447 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.095406 2581 scope.go:117] "RemoveContainer" containerID="73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7" Jul 18 01:12:40.095721 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:12:40.095701 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7\": container with ID starting with 73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7 not found: ID does not exist" containerID="73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7" Jul 18 01:12:40.095764 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.095732 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7"} err="failed to get container status \"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7\": rpc error: code = NotFound desc = could not find container \"73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7\": container with ID starting with 73682a0d3c647b80fea71c07a5629fcc7b0452bb4a07144f96b8ad0b949026f7 not found: ID does not exist" Jul 18 01:12:40.106600 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.106572 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:12:40.110472 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.110452 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-3482f028/e2e-lifecycle-model-3482f028-kserve-6dd8788547-whtw5"] Jul 18 01:12:40.835905 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:12:40.835861 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcfd4f3-24bf-4391-ac63-467254956886" path="/var/lib/kubelet/pods/4dcfd4f3-24bf-4391-ac63-467254956886/volumes" Jul 18 01:13:03.372815 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:13:03.372778 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:14:01.825949 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.825919 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:14:01.828265 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.826211 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcfd4f3-24bf-4391-ac63-467254956886" containerName="main" Jul 18 01:14:01.828265 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.826236 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcfd4f3-24bf-4391-ac63-467254956886" containerName="main" Jul 18 01:14:01.828265 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.826332 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcfd4f3-24bf-4391-ac63-467254956886" containerName="main" Jul 18 01:14:01.829148 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.829128 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.831489 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.831466 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9d3231-openshift-default-dockercfg-2p9gf\"" Jul 18 01:14:01.831857 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.831832 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.831947 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.831872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832027 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.831942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832027 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.831987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832135 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.832046 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832135 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.832112 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832280 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.832138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqth\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832280 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.832164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.832280 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.832181 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.842342 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.842300 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:14:01.933059 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933110 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933177 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933211 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933358 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqth\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933505 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.933541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.933530 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.934117 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.934092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.934243 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.934096 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.934327 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.934280 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.936222 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.936196 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.936653 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.936632 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.944434 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.944412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqth\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:01.945465 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:01.945443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token\") pod \"e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:02.140026 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.139983 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:02.275849 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.275824 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:14:02.277971 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:14:02.277940 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda648a06c_b912_4222_873e_38acdabe3778.slice/crio-b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf WatchSource:0}: Error finding container b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf: Status 404 returned error can't find the container with id b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf Jul 18 01:14:02.280044 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.280011 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:02.280141 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.280080 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:02.280141 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.280108 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:02.449253 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.449167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerStarted","Data":"63f16afd04f9fb351cd7a6cb23103f1e27cf7e6eb86f9968f38553dd622e669f"} Jul 18 01:14:02.449253 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.449221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerStarted","Data":"b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf"} Jul 18 01:14:02.468961 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:02.468135 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podStartSLOduration=1.468116043 podStartE2EDuration="1.468116043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:14:02.467131887 +0000 UTC m=+2008.167998946" watchObservedRunningTime="2026-07-18 01:14:02.468116043 +0000 UTC m=+2008.168983064" Jul 18 01:14:03.141109 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:03.141063 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:03.145807 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:03.145785 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:03.454774 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:03.454694 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:03.455739 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:03.455722 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:08.581905 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:08.581869 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:14:16.516633 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.516600 2581 generic.go:356] "Generic (PLEG): container finished" podID="a648a06c-b912-4222-873e-38acdabe3778" containerID="63f16afd04f9fb351cd7a6cb23103f1e27cf7e6eb86f9968f38553dd622e669f" exitCode=0 Jul 18 01:14:16.517047 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.516672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerDied","Data":"63f16afd04f9fb351cd7a6cb23103f1e27cf7e6eb86f9968f38553dd622e669f"} Jul 18 01:14:16.517047 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.517045 2581 scope.go:117] "RemoveContainer" containerID="63f16afd04f9fb351cd7a6cb23103f1e27cf7e6eb86f9968f38553dd622e669f" Jul 18 01:14:16.517979 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.517954 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:16.518040 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.518025 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:16.518080 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:16.518067 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:14:17.523215 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:17.523178 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerStarted","Data":"34cdb959cd1552584a20e23dda82186bc76f1cd40d9148cff79737017f065fc5"} Jul 18 01:14:18.141605 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:18.141560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:18.141813 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:18.141755 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 18 01:14:18.141882 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:18.141802 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 18 01:14:18.455054 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:18.454944 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:19.141652 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:19.141170 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 18 01:14:19.141652 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:19.141232 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 18 01:14:19.694858 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:19.694823 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:14:20.140527 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:20.140489 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 18 01:14:20.140817 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:20.140785 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 18 01:14:21.140838 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:21.140796 2581 patch_prober.go:28] interesting pod/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 18 01:14:21.141483 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:21.141447 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 18 01:14:22.144777 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:22.144742 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:22.146567 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:22.146544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:14:41.875696 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:14:41.875657 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:15:13.384847 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:15:13.384805 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:15:31.589749 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:15:31.589705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:15:34.859621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:15:34.859585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:15:34.860048 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:15:34.859680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:16:09.814391 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:09.814360 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:16:09.814851 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:09.814581 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" containerID="cri-o://34cdb959cd1552584a20e23dda82186bc76f1cd40d9148cff79737017f065fc5" gracePeriod=30 Jul 18 01:16:13.781342 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:13.781294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:16:15.065383 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.065352 2581 generic.go:356] "Generic (PLEG): container finished" podID="a648a06c-b912-4222-873e-38acdabe3778" containerID="34cdb959cd1552584a20e23dda82186bc76f1cd40d9148cff79737017f065fc5" exitCode=0 Jul 18 01:16:15.065734 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.065384 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerDied","Data":"34cdb959cd1552584a20e23dda82186bc76f1cd40d9148cff79737017f065fc5"} Jul 18 01:16:15.065734 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.065444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" event={"ID":"a648a06c-b912-4222-873e-38acdabe3778","Type":"ContainerDied","Data":"b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf"} Jul 18 01:16:15.065734 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.065468 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6536a489cd740b26d2c51a5d3984919668e20f3bbede0fa5b221b0356f60baf" Jul 18 01:16:15.065734 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.065486 2581 scope.go:117] "RemoveContainer" containerID="63f16afd04f9fb351cd7a6cb23103f1e27cf7e6eb86f9968f38553dd622e669f" Jul 18 01:16:15.068017 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.068001 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:16:15.178398 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178352 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178398 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178405 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdqth\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178444 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178475 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178507 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178547 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178579 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178650 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178615 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178938 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178654 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket\") pod \"a648a06c-b912-4222-873e-38acdabe3778\" (UID: \"a648a06c-b912-4222-873e-38acdabe3778\") " Jul 18 01:16:15.178938 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178751 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:15.178938 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178812 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:15.179077 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178970 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:15.179077 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.178982 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.179077 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.179002 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.179228 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.179079 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:16:15.179506 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.179482 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data" (OuterVolumeSpecName: "istio-data") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:15.180601 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.180579 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token" (OuterVolumeSpecName: "istio-token") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:15.180803 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.180775 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:16:15.181084 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.181064 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth" (OuterVolumeSpecName: "kube-api-access-xdqth") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "kube-api-access-xdqth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:15.181144 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.181105 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a648a06c-b912-4222-873e-38acdabe3778" (UID: "a648a06c-b912-4222-873e-38acdabe3778"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:15.279563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279533 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279558 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdqth\" (UniqueName: \"kubernetes.io/projected/a648a06c-b912-4222-873e-38acdabe3778-kube-api-access-xdqth\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279563 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279567 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279997 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279576 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279997 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279584 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a648a06c-b912-4222-873e-38acdabe3778-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279997 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279592 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a648a06c-b912-4222-873e-38acdabe3778-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:15.279997 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:15.279600 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a648a06c-b912-4222-873e-38acdabe3778-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:16.071419 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:16.071387 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd" Jul 18 01:16:16.108585 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:16.108554 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:16:16.113597 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:16.113570 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9d3231-openshift-default-7c7c985f6f-qq4zd"] Jul 18 01:16:16.834676 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:16.834636 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a648a06c-b912-4222-873e-38acdabe3778" path="/var/lib/kubelet/pods/a648a06c-b912-4222-873e-38acdabe3778/volumes" Jul 18 01:16:17.556963 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.556933 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:17.557397 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.557243 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:17.557397 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.557254 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:17.557397 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.557270 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:17.557397 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.557276 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:17.557397 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.557362 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:17.561716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.561698 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.564800 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.564779 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d16b2c-openshift-default-dockercfg-c9xcc\"" Jul 18 01:16:17.573034 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.573008 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:17.602353 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602500 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602361 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602500 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602500 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602448 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602676 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602498 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zpk5\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602676 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602676 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602584 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602676 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602630 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.602819 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.602683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703648 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.703868 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.703831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zpk5\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.704253 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.704032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.704253 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.704113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.704355 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.704262 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.704355 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.704321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.704433 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.704399 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.705881 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.705851 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.706482 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.706464 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.711084 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.711063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zpk5\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.711597 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.711579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token\") pod \"e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:17.871903 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:17.871811 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:18.006476 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:18.006444 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:18.021926 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:16:18.021898 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c29462c_48a6_48fd_9c89_c369a3a6ce95.slice/crio-4e3b9b82641d8955806baf83453f8674edcb996e0fe278508cdac6b9f478f772 WatchSource:0}: Error finding container 4e3b9b82641d8955806baf83453f8674edcb996e0fe278508cdac6b9f478f772: Status 404 returned error can't find the container with id 4e3b9b82641d8955806baf83453f8674edcb996e0fe278508cdac6b9f478f772 Jul 18 01:16:18.024135 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:18.024102 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:18.024218 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:18.024166 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:18.024218 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:18.024195 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:18.081930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:18.081904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerStarted","Data":"4e3b9b82641d8955806baf83453f8674edcb996e0fe278508cdac6b9f478f772"} Jul 18 01:16:19.087922 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:19.087881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerStarted","Data":"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec"} Jul 18 01:16:19.111181 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:19.111125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podStartSLOduration=2.111109446 podStartE2EDuration="2.111109446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:16:19.109657521 +0000 UTC m=+2144.810524553" watchObservedRunningTime="2026-07-18 01:16:19.111109446 +0000 UTC m=+2144.811976466" Jul 18 01:16:19.872712 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:19.872681 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:19.877425 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:19.877399 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:20.093246 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:20.093209 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:20.094368 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:20.094347 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:24.384285 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:24.384249 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:16:33.154600 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.154567 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerID="9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec" exitCode=0 Jul 18 01:16:33.155024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.154606 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerDied","Data":"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec"} Jul 18 01:16:33.155024 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.154995 2581 scope.go:117] "RemoveContainer" containerID="9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec" Jul 18 01:16:33.155997 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.155967 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:33.156050 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.156034 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:33.156085 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:33.156069 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:34.161272 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:34.161235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerStarted","Data":"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd"} Jul 18 01:16:34.872802 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:34.872766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:34.873891 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:34.873858 2581 patch_prober.go:28] interesting pod/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 18 01:16:34.874025 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:34.873927 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 18 01:16:35.093449 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:35.093412 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:35.872806 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:35.872772 2581 patch_prober.go:28] interesting pod/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 18 01:16:35.873342 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:35.873280 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 18 01:16:36.872855 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:36.872822 2581 patch_prober.go:28] interesting pod/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 18 01:16:36.873258 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:36.872884 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 18 01:16:37.872550 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:37.872507 2581 patch_prober.go:28] interesting pod/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 18 01:16:37.872737 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:37.872571 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 18 01:16:38.875940 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:38.875900 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:38.876882 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:38.876864 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:42.596670 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:42.596638 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:16:48.616447 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:48.616409 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:48.617218 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:48.616606 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" containerID="cri-o://3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd" gracePeriod=30 Jul 18 01:16:53.876394 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.876367 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:53.921553 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921561 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zpk5\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921593 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921621 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921646 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921673 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.921716 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921713 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.922035 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921737 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.922035 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket\") pod \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\" (UID: \"4c29462c-48a6-48fd-9c89-c369a3a6ce95\") " Jul 18 01:16:53.922035 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921878 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:53.922035 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.921929 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:53.922239 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.922098 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:53.922239 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.922158 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:53.922239 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.922179 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:53.922436 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.922275 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:16:53.922661 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.922636 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:53.923810 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.923787 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5" (OuterVolumeSpecName: "kube-api-access-4zpk5") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "kube-api-access-4zpk5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:53.924021 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.924006 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:16:53.924171 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.924151 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:16:53.924224 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.924164 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c29462c-48a6-48fd-9c89-c369a3a6ce95" (UID: "4c29462c-48a6-48fd-9c89-c369a3a6ce95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:16:53.977022 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:53.976981 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:16:54.023621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023589 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023617 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zpk5\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-kube-api-access-4zpk5\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023621 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023628 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023857 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023637 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023857 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023646 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023857 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023658 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.023857 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.023669 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c29462c-48a6-48fd-9c89-c369a3a6ce95-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:16:54.250363 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.250248 2581 generic.go:356] "Generic (PLEG): container finished" podID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerID="3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd" exitCode=0 Jul 18 01:16:54.250363 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.250296 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" Jul 18 01:16:54.250363 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.250333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerDied","Data":"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd"} Jul 18 01:16:54.250613 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.250395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r" event={"ID":"4c29462c-48a6-48fd-9c89-c369a3a6ce95","Type":"ContainerDied","Data":"4e3b9b82641d8955806baf83453f8674edcb996e0fe278508cdac6b9f478f772"} Jul 18 01:16:54.250613 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.250426 2581 scope.go:117] "RemoveContainer" containerID="3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd" Jul 18 01:16:54.259746 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.259734 2581 scope.go:117] "RemoveContainer" containerID="9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec" Jul 18 01:16:54.267098 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.267081 2581 scope.go:117] "RemoveContainer" containerID="3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd" Jul 18 01:16:54.267437 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:16:54.267406 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd\": container with ID starting with 3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd not found: ID does not exist" containerID="3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd" Jul 18 01:16:54.267537 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.267443 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd"} err="failed to get container status \"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd\": rpc error: code = NotFound desc = could not find container \"3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd\": container with ID starting with 3ef84abd2d9933d94ceb2fab5369707303e0a0ec8833292ea482a7cab0532afd not found: ID does not exist" Jul 18 01:16:54.267537 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.267459 2581 scope.go:117] "RemoveContainer" containerID="9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec" Jul 18 01:16:54.267735 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:16:54.267716 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec\": container with ID starting with 9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec not found: ID does not exist" containerID="9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec" Jul 18 01:16:54.267775 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.267742 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec"} err="failed to get container status \"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec\": rpc error: code = NotFound desc = could not find container \"9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec\": container with ID starting with 9ffaf8e76a1ee92b4c708a0f3512a3eba224736d723d6e66b856a5b14a37feec not found: ID does not exist" Jul 18 01:16:54.272356 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.272335 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:54.276208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.276189 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d16b2c-openshift-default-65fb594f9-9fk4r"] Jul 18 01:16:54.836290 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:54.836259 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" path="/var/lib/kubelet/pods/4c29462c-48a6-48fd-9c89-c369a3a6ce95/volumes" Jul 18 01:16:56.181411 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.181381 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:16:56.181865 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.181828 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:16:56.181865 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.181847 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:16:56.181988 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.181937 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:16:56.181988 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.181951 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a648a06c-b912-4222-873e-38acdabe3778" containerName="istio-proxy" Jul 18 01:16:56.191771 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.191738 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.194133 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.194108 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5a99f1-openshift-default-dockercfg-w2bvv\"" Jul 18 01:16:56.194393 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.194372 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:16:56.242055 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242113 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg5hv\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242166 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242210 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242489 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.242489 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.242336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.342917 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.342882 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343092 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.342930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343092 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.342966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343092 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.342984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg5hv\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343092 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343092 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343026 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343362 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343362 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343362 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343293 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343362 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343583 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343416 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343660 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343862 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.343862 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.343832 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.345722 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.345691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.345872 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.345853 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.351040 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.351012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg5hv\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.351180 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.351160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token\") pod \"e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.503375 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.503264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:56.642622 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.642585 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:16:56.644961 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:16:56.644891 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816e8f28_05ef_497a_83f5_46212acabcf4.slice/crio-8cea980156c48939f7967a11d2b4f54375674fdaf835b352433aff26f7e22848 WatchSource:0}: Error finding container 8cea980156c48939f7967a11d2b4f54375674fdaf835b352433aff26f7e22848: Status 404 returned error can't find the container with id 8cea980156c48939f7967a11d2b4f54375674fdaf835b352433aff26f7e22848 Jul 18 01:16:56.647408 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.647366 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:56.647494 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.647447 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:56.647494 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:56.647483 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:16:57.266152 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:57.266114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerStarted","Data":"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e"} Jul 18 01:16:57.266644 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:57.266173 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerStarted","Data":"8cea980156c48939f7967a11d2b4f54375674fdaf835b352433aff26f7e22848"} Jul 18 01:16:57.286638 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:57.286578 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podStartSLOduration=1.286561035 podStartE2EDuration="1.286561035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:16:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:16:57.284568373 +0000 UTC m=+2182.985435410" watchObservedRunningTime="2026-07-18 01:16:57.286561035 +0000 UTC m=+2182.987428054" Jul 18 01:16:57.503904 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:57.503865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:57.508529 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:57.508504 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:58.270449 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:58.270422 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:16:58.271352 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:16:58.271333 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:17:06.501244 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:06.501211 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:17:14.160775 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.159422 2581 patch_prober.go:28] interesting pod/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:59864->10.134.0.40:15021: read: connection reset by peer" start-of-body= Jul 18 01:17:14.160775 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.159506 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": read tcp 10.134.0.2:59864->10.134.0.40:15021: read: connection reset by peer" Jul 18 01:17:14.347106 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.347023 2581 generic.go:356] "Generic (PLEG): container finished" podID="816e8f28-05ef-497a-83f5-46212acabcf4" containerID="d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e" exitCode=0 Jul 18 01:17:14.347106 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.347074 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerDied","Data":"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e"} Jul 18 01:17:14.347447 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.347431 2581 scope.go:117] "RemoveContainer" containerID="d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e" Jul 18 01:17:14.348474 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.348442 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:17:14.348595 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.348526 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:17:14.348595 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:14.348575 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 18 01:17:15.356349 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:15.356293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerStarted","Data":"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832"} Jul 18 01:17:15.504181 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:15.504144 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:17:15.504401 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:15.504377 2581 patch_prober.go:28] interesting pod/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 18 01:17:15.504456 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:15.504427 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 18 01:17:16.503842 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:16.503806 2581 patch_prober.go:28] interesting pod/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 18 01:17:16.504249 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:16.503860 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 18 01:17:17.504421 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:17.504384 2581 patch_prober.go:28] interesting pod/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 18 01:17:17.504807 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:17.504442 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 18 01:17:18.504332 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:18.504277 2581 patch_prober.go:28] interesting pod/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 18 01:17:18.504512 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:18.504353 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 18 01:17:19.507100 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:19.507070 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:17:19.507626 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:19.507474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:17:19.508156 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:19.508136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:17:20.585626 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:17:20.585589 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:20:20.791063 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:20.791026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:20:23.499256 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:23.499212 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:20:23.499756 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:23.499442 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" containerID="cri-o://2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832" gracePeriod=30 Jul 18 01:20:28.752411 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.752389 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:20:28.924427 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924397 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924427 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924433 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924666 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924465 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924666 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924481 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924666 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924642 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924825 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924689 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg5hv\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924825 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924767 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.924825 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924775 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:28.924825 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924810 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.925016 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924846 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy\") pod \"816e8f28-05ef-497a-83f5-46212acabcf4\" (UID: \"816e8f28-05ef-497a-83f5-46212acabcf4\") " Jul 18 01:20:28.925016 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924924 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:28.925016 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.924946 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:20:28.925200 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.925134 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:28.925200 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.925146 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/816e8f28-05ef-497a-83f5-46212acabcf4-istiod-ca-cert\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:28.925200 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.925167 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-credential-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:28.925200 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.925182 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-certs\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:28.925833 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.925809 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:28.926866 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.926831 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:20:28.926981 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.926836 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv" (OuterVolumeSpecName: "kube-api-access-mg5hv") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "kube-api-access-mg5hv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:20:28.927076 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.927058 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:20:28.927165 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:28.927147 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "816e8f28-05ef-497a-83f5-46212acabcf4" (UID: "816e8f28-05ef-497a-83f5-46212acabcf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:20:29.026266 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026233 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/816e8f28-05ef-497a-83f5-46212acabcf4-istio-podinfo\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.026266 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026262 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-istio-token\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.026266 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026271 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg5hv\" (UniqueName: \"kubernetes.io/projected/816e8f28-05ef-497a-83f5-46212acabcf4-kube-api-access-mg5hv\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.026508 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026280 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-data\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.026508 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026289 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-workload-socket\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.026508 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.026296 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/816e8f28-05ef-497a-83f5-46212acabcf4-istio-envoy\") on node \"ip-10-0-130-15.ec2.internal\" DevicePath \"\"" Jul 18 01:20:29.223174 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.223074 2581 generic.go:356] "Generic (PLEG): container finished" podID="816e8f28-05ef-497a-83f5-46212acabcf4" containerID="2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832" exitCode=0 Jul 18 01:20:29.223174 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.223140 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" Jul 18 01:20:29.223455 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.223163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerDied","Data":"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832"} Jul 18 01:20:29.223455 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.223227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx" event={"ID":"816e8f28-05ef-497a-83f5-46212acabcf4","Type":"ContainerDied","Data":"8cea980156c48939f7967a11d2b4f54375674fdaf835b352433aff26f7e22848"} Jul 18 01:20:29.223455 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.223257 2581 scope.go:117] "RemoveContainer" containerID="2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832" Jul 18 01:20:29.233645 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.233619 2581 scope.go:117] "RemoveContainer" containerID="d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e" Jul 18 01:20:29.241345 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.241321 2581 scope.go:117] "RemoveContainer" containerID="2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832" Jul 18 01:20:29.241587 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:20:29.241568 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832\": container with ID starting with 2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832 not found: ID does not exist" containerID="2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832" Jul 18 01:20:29.241642 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.241595 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832"} err="failed to get container status \"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832\": rpc error: code = NotFound desc = could not find container \"2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832\": container with ID starting with 2351917178fa202399362adf81632c37e5ca2e86eaf2d38b5a32756f7995c832 not found: ID does not exist" Jul 18 01:20:29.241642 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.241613 2581 scope.go:117] "RemoveContainer" containerID="d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e" Jul 18 01:20:29.241852 ip-10-0-130-15 kubenswrapper[2581]: E0718 01:20:29.241837 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e\": container with ID starting with d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e not found: ID does not exist" containerID="d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e" Jul 18 01:20:29.241891 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.241855 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e"} err="failed to get container status \"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e\": rpc error: code = NotFound desc = could not find container \"d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e\": container with ID starting with d286793c9e60bcbeaa8660af6329116f802295e0dc353357ffb97e12ff54bf9e not found: ID does not exist" Jul 18 01:20:29.248194 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.248173 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:20:29.254508 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:29.254488 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5a99f1-openshift-default-65cd88877f-sgmqx"] Jul 18 01:20:30.835132 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:30.835095 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" path="/var/lib/kubelet/pods/816e8f28-05ef-497a-83f5-46212acabcf4/volumes" Jul 18 01:20:31.629286 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:31.629254 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66845895-5xkh4_8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa/authorino/0.log" Jul 18 01:20:33.385084 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:33.385038 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zp7nw"] Jul 18 01:20:34.884719 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:34.884693 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:20:34.885666 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:34.885639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qt8nd_4c6778b5-044f-4a9b-bd04-c8980a63e6be/ovn-acl-logging/0.log" Jul 18 01:20:34.973258 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:34.973226 2581 scope.go:117] "RemoveContainer" containerID="34cdb959cd1552584a20e23dda82186bc76f1cd40d9148cff79737017f065fc5" Jul 18 01:20:37.118599 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:37.118570 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-tfv8p_b2a0f0c3-503a-4ffe-95d3-96a485caa7af/copy-manifests/0.log" Jul 18 01:20:37.131122 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:37.131092 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-tfv8p_b2a0f0c3-503a-4ffe-95d3-96a485caa7af/manager/0.log" Jul 18 01:20:38.393415 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:38.393384 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66845895-5xkh4_8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa/authorino/0.log" Jul 18 01:20:38.637398 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:38.637364 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-q5b5x_a7f3da57-2044-4091-8587-3499d8e48fa5/manager/0.log" Jul 18 01:20:38.861011 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:38.860924 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vgbld_68951e49-83d2-4809-bc6a-79f4ece2d445/registry-server/0.log" Jul 18 01:20:38.987565 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:38.987537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-shlgw_241c8201-8979-4c71-ba0a-53b5804fea1f/manager/0.log" Jul 18 01:20:39.106754 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:39.106722 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zp7nw_f8b5e513-80c3-4d81-a056-b4b883029baa/limitador/0.log" Jul 18 01:20:39.219138 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:39.219106 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9wl4w_2111b515-43d8-4fa3-9286-b2ab3db6003b/manager/0.log" Jul 18 01:20:39.579649 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:39.579556 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hh79t_6841d542-5b19-45d5-9500-58e8983a0bea/istio-proxy/0.log" Jul 18 01:20:40.052297 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:40.052265 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/1.log" Jul 18 01:20:41.308932 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:41.308901 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5v86s_2f46f9ee-69ee-481c-a3fe-8415740a6973/main/0.log" Jul 18 01:20:45.467561 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467528 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z5qjz/must-gather-9bf9b"] Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467828 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467839 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467850 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467856 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467872 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467877 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467926 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.467930 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.467933 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c29462c-48a6-48fd-9c89-c369a3a6ce95" containerName="istio-proxy" Jul 18 01:20:45.468190 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.468024 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="816e8f28-05ef-497a-83f5-46212acabcf4" containerName="istio-proxy" Jul 18 01:20:45.470811 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.470791 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.473424 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.473402 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"openshift-service-ca.crt\"" Jul 18 01:20:45.473424 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.473415 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z5qjz\"/\"default-dockercfg-k524g\"" Jul 18 01:20:45.474381 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.474367 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z5qjz\"/\"kube-root-ca.crt\"" Jul 18 01:20:45.480086 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.480062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/must-gather-9bf9b"] Jul 18 01:20:45.560097 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.560065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/641bedc4-466f-4089-a1bd-36cad03797df-must-gather-output\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.560239 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.560101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bfgb\" (UniqueName: \"kubernetes.io/projected/641bedc4-466f-4089-a1bd-36cad03797df-kube-api-access-8bfgb\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.660887 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.660855 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/641bedc4-466f-4089-a1bd-36cad03797df-must-gather-output\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.661016 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.660893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bfgb\" (UniqueName: \"kubernetes.io/projected/641bedc4-466f-4089-a1bd-36cad03797df-kube-api-access-8bfgb\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.661264 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.661243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/641bedc4-466f-4089-a1bd-36cad03797df-must-gather-output\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.675677 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.675655 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bfgb\" (UniqueName: \"kubernetes.io/projected/641bedc4-466f-4089-a1bd-36cad03797df-kube-api-access-8bfgb\") pod \"must-gather-9bf9b\" (UID: \"641bedc4-466f-4089-a1bd-36cad03797df\") " pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.780457 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.780382 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" Jul 18 01:20:45.916005 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.915863 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/must-gather-9bf9b"] Jul 18 01:20:45.918185 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:20:45.918155 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod641bedc4_466f_4089_a1bd_36cad03797df.slice/crio-693aafb1e659dbc0f8fb96fb940634da4783adc0a736323e160aaba3456d8960 WatchSource:0}: Error finding container 693aafb1e659dbc0f8fb96fb940634da4783adc0a736323e160aaba3456d8960: Status 404 returned error can't find the container with id 693aafb1e659dbc0f8fb96fb940634da4783adc0a736323e160aaba3456d8960 Jul 18 01:20:45.920021 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:45.920001 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:20:46.298386 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:46.298350 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" event={"ID":"641bedc4-466f-4089-a1bd-36cad03797df","Type":"ContainerStarted","Data":"693aafb1e659dbc0f8fb96fb940634da4783adc0a736323e160aaba3456d8960"} Jul 18 01:20:47.306944 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:47.306912 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" event={"ID":"641bedc4-466f-4089-a1bd-36cad03797df","Type":"ContainerStarted","Data":"17e45a8f2641d809195e8bb7f82a7fd7280dfbe386fa985fe132951c158f4135"} Jul 18 01:20:47.307392 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:47.306958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" event={"ID":"641bedc4-466f-4089-a1bd-36cad03797df","Type":"ContainerStarted","Data":"351e919f0fa8c466163b6358f3e4d34a9a4a249ccd5e3bc7efed7a841e75bcc5"} Jul 18 01:20:47.323939 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:47.323876 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z5qjz/must-gather-9bf9b" podStartSLOduration=1.518214914 podStartE2EDuration="2.323856418s" totalImagesPullingTime="805.641504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:20:47.322836288 +0000 UTC m=+2413.023703337" watchObservedRunningTime="2026-07-18 01:20:47.323856418 +0000 UTC m=+2413.024723439" Jul 18 01:20:48.406436 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:48.406396 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r4jbh_5861b829-9730-49e3-9359-db5f78ffe35c/global-pull-secret-syncer/0.log" Jul 18 01:20:48.491541 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:48.491511 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-svr22_d83e1961-e070-4cac-9e8c-e705452b0511/konnectivity-agent/0.log" Jul 18 01:20:48.547518 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:48.547493 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-15.ec2.internal_29a82543545f703d857cb6e9837878f6/haproxy/0.log" Jul 18 01:20:53.600333 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.599372 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f66845895-5xkh4_8a3e4bfa-5a50-4d3e-abfd-846c5e49d8aa/authorino/0.log" Jul 18 01:20:53.669668 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.669641 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-q5b5x_a7f3da57-2044-4091-8587-3499d8e48fa5/manager/0.log" Jul 18 01:20:53.739359 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.739220 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vgbld_68951e49-83d2-4809-bc6a-79f4ece2d445/registry-server/0.log" Jul 18 01:20:53.891327 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.890629 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-shlgw_241c8201-8979-4c71-ba0a-53b5804fea1f/manager/0.log" Jul 18 01:20:53.920330 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.920045 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zp7nw_f8b5e513-80c3-4d81-a056-b4b883029baa/limitador/0.log" Jul 18 01:20:53.991575 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:53.991058 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9wl4w_2111b515-43d8-4fa3-9286-b2ab3db6003b/manager/0.log" Jul 18 01:20:56.187839 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.187789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sch2n_6532e939-516b-4e7c-badd-c2322b30072b/node-exporter/0.log" Jul 18 01:20:56.208915 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.208885 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sch2n_6532e939-516b-4e7c-badd-c2322b30072b/kube-rbac-proxy/0.log" Jul 18 01:20:56.234816 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.234788 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sch2n_6532e939-516b-4e7c-badd-c2322b30072b/init-textfile/0.log" Jul 18 01:20:56.270983 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.270952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gfqth_1cd302a2-be21-484a-8440-eb16e550aa17/kube-rbac-proxy-main/0.log" Jul 18 01:20:56.290684 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.290634 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gfqth_1cd302a2-be21-484a-8440-eb16e550aa17/kube-rbac-proxy-self/0.log" Jul 18 01:20:56.324863 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:56.324835 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gfqth_1cd302a2-be21-484a-8440-eb16e550aa17/openshift-state-metrics/0.log" Jul 18 01:20:58.303017 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.302967 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x"] Jul 18 01:20:58.317090 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.317048 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.320406 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.319759 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x"] Jul 18 01:20:58.393010 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.392960 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4925\" (UniqueName: \"kubernetes.io/projected/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-kube-api-access-r4925\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.393208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.393025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-lib-modules\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.393208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.393056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-podres\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.393208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.393105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-sys\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.393208 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.393126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-proc\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.494279 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494243 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4925\" (UniqueName: \"kubernetes.io/projected/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-kube-api-access-r4925\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.494582 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494558 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-lib-modules\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.494723 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494707 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-podres\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.494904 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494876 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-podres\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.494904 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-sys\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.495042 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.494795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-lib-modules\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.495194 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.495177 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-sys\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.495291 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.495239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-proc\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.495467 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.495296 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-proc\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.504371 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.504344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4925\" (UniqueName: \"kubernetes.io/projected/6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06-kube-api-access-r4925\") pod \"perf-node-gather-daemonset-ngp5x\" (UID: \"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06\") " pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.631298 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.631265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:58.817595 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:58.817504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x"] Jul 18 01:20:58.826469 ip-10-0-130-15 kubenswrapper[2581]: W0718 01:20:58.826417 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a2dd6ae_3b19_477a_b614_7dbf0fe5cb06.slice/crio-50070a2bd004b73b47f9ba9c93983c2cb5e71d5d9c98b14f1699d0b2e45278f6 WatchSource:0}: Error finding container 50070a2bd004b73b47f9ba9c93983c2cb5e71d5d9c98b14f1699d0b2e45278f6: Status 404 returned error can't find the container with id 50070a2bd004b73b47f9ba9c93983c2cb5e71d5d9c98b14f1699d0b2e45278f6 Jul 18 01:20:59.402057 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:59.402021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" event={"ID":"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06","Type":"ContainerStarted","Data":"fb729ee789122844e58f386b433ccd62a3b12a4ded001aacc4f3eaf77360380f"} Jul 18 01:20:59.402494 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:59.402078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" event={"ID":"6a2dd6ae-3b19-477a-b614-7dbf0fe5cb06","Type":"ContainerStarted","Data":"50070a2bd004b73b47f9ba9c93983c2cb5e71d5d9c98b14f1699d0b2e45278f6"} Jul 18 01:20:59.402494 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:59.402177 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:20:59.420944 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:20:59.420895 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" podStartSLOduration=1.420878066 podStartE2EDuration="1.420878066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:20:59.419725892 +0000 UTC m=+2425.120592933" watchObservedRunningTime="2026-07-18 01:20:59.420878066 +0000 UTC m=+2425.121745086" Jul 18 01:21:00.927546 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:00.927517 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nj665_da02bdd2-5e15-45aa-89cf-172b7ef7b342/dns/0.log" Jul 18 01:21:00.949552 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:00.949526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nj665_da02bdd2-5e15-45aa-89cf-172b7ef7b342/kube-rbac-proxy/0.log" Jul 18 01:21:01.028440 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:01.028414 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9k4sj_130041cd-4239-4c21-b63d-2efd8ac81a49/dns-node-resolver/0.log" Jul 18 01:21:01.633697 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:01.633669 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-665j9_67549c68-7007-460f-818e-ffecdd166d07/node-ca/0.log" Jul 18 01:21:02.664842 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:02.664813 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hh79t_6841d542-5b19-45d5-9500-58e8983a0bea/istio-proxy/0.log" Jul 18 01:21:02.914475 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:02.914440 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/0.log" Jul 18 01:21:02.954748 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:02.954664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/1.log" Jul 18 01:21:03.768255 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:03.768226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wwgh8_0c76e302-fce9-4b64-96d0-15c3ee3573ab/serve-healthcheck-canary/0.log" Jul 18 01:21:04.340200 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:04.340174 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcpwb_5b844f20-67a5-4eb9-a016-0a37fd526693/kube-rbac-proxy/0.log" Jul 18 01:21:04.362231 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:04.362174 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcpwb_5b844f20-67a5-4eb9-a016-0a37fd526693/exporter/0.log" Jul 18 01:21:04.386237 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:04.386212 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mcpwb_5b844f20-67a5-4eb9-a016-0a37fd526693/extractor/0.log" Jul 18 01:21:05.420154 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:05.420126 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z5qjz/perf-node-gather-daemonset-ngp5x" Jul 18 01:21:07.259294 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:07.259249 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-tfv8p_b2a0f0c3-503a-4ffe-95d3-96a485caa7af/manager/0.log" Jul 18 01:21:07.304373 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:07.304347 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794f69c6d-tfv8p_b2a0f0c3-503a-4ffe-95d3-96a485caa7af/copy-manifests/0.log" Jul 18 01:21:08.792515 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:08.792487 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fb6694444-26qqg_0b09db53-bf6e-4fad-9a87-a37a06138ce4/manager/0.log" Jul 18 01:21:08.945719 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:08.945663 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hh79t_6841d542-5b19-45d5-9500-58e8983a0bea/istio-proxy/0.log" Jul 18 01:21:09.089599 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:09.089523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/0.log" Jul 18 01:21:09.125582 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:09.125548 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/1.log" Jul 18 01:21:10.418231 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:10.418179 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678hh79t_6841d542-5b19-45d5-9500-58e8983a0bea/istio-proxy/0.log" Jul 18 01:21:10.562943 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:10.562858 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/0.log" Jul 18 01:21:10.596495 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:10.596465 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-nqg62_817f8c74-c34d-4a29-8cb8-a33387b9461d/istio-proxy/1.log" Jul 18 01:21:15.452272 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.452228 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/kube-multus-additional-cni-plugins/0.log" Jul 18 01:21:15.479197 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.479169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/egress-router-binary-copy/0.log" Jul 18 01:21:15.500920 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.500895 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/cni-plugins/0.log" Jul 18 01:21:15.523203 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.523176 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/bond-cni-plugin/0.log" Jul 18 01:21:15.548800 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.548768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/routeoverride-cni/0.log" Jul 18 01:21:15.574859 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.574829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/whereabouts-cni-bincopy/0.log" Jul 18 01:21:15.599880 ip-10-0-130-15 kubenswrapper[2581]: I0718 01:21:15.599846 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5nbk2_d3ad45a2-8123-4535-84bd-d327227dc6eb/whereabouts-cni/0.log"